2024-02-17T23:02:50.106 INFO:root:teuthology version: 0.0.1.dev260+gb1dac55 2024-02-17T23:02:50.106 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi --description rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} --owner scheduled_yuriw@teuthology --verbose --archive /home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822 -- /home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822/orig.config.yaml 2024-02-17T23:02:50.138 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T23:02:50.225 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822 branch: pacific-release description: rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} email: yweinste@redhat.com first_in_suite: false job_id: '7564822' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: pacific-release ceph: conf: global: mon election default strategy: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MON_DOWN\) - \(PG_ - mons down - pg inactive - out of quorum - \(OSD_ - osds down - osd down sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 workunit: branch: pacific-release sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 owner: scheduled_yuriw@teuthology priority: 51 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 264 sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: pacific-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 targets: smithi005.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEi/q6q9cSCdDsNG3vOT0GVRK20cTPyeLWTmaUOkRx/X7d4JixlnQrP1LBsInvMn9q18V+XH7R+Ene4+lX9R+8M= smithi080.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPac3XTqtko2AcPKYOPyZA5UxPGVtEyMaMfnnW0moZX1kkEY8S2VKHYV5qPwqcCwoyo9OIw+2lDqqaTPUxYoBCE= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - cephadm: add_mons_via_daemon_add: true allow_ptrace: false avoid_pacific_features: true cephadm_branch: v15.2.0 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v15.2.0 - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw r z --placement=2 --port=8000 - sleep 120 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: b1dac5519c57c269ea98a22fb7729016a1d0e4d2 timestamp: 2024-02-17_15:55:51 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-02-17T23:02:50.225 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa; will attempt to use it 2024-02-17T23:02:50.225 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_81bd20d634209c7cb82c18be12b4b5a05643ebf1/qa/tasks 2024-02-17T23:02:50.226 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-02-17T23:02:50.227 INFO:teuthology.task.internal:Checking packages... 2024-02-17T23:02:50.252 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '81bd20d634209c7cb82c18be12b4b5a05643ebf1' 2024-02-17T23:02:50.252 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-02-17T23:02:50.252 INFO:teuthology.packaging:ref: None 2024-02-17T23:02:50.253 INFO:teuthology.packaging:tag: None 2024-02-17T23:02:50.253 INFO:teuthology.packaging:branch: pacific-release 2024-02-17T23:02:50.253 INFO:teuthology.packaging:sha1: 81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-17T23:02:50.253 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific-release 2024-02-17T23:02:50.493 INFO:teuthology.task.internal:Found packages for ceph version 16.2.14-548.g81bd20d6 2024-02-17T23:02:50.494 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-02-17T23:02:50.501 INFO:teuthology.task.internal:no buildpackages task found 2024-02-17T23:02:50.501 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-02-17T23:02:50.507 INFO:teuthology.task.internal:Saving configuration 2024-02-17T23:02:50.519 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-02-17T23:02:50.525 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T23:02:50.551 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 22:57:55.546841', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEi/q6q9cSCdDsNG3vOT0GVRK20cTPyeLWTmaUOkRx/X7d4JixlnQrP1LBsInvMn9q18V+XH7R+Ene4+lX9R+8M='} 2024-02-17T23:02:50.572 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 22:57:55.545014', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPac3XTqtko2AcPKYOPyZA5UxPGVtEyMaMfnnW0moZX1kkEY8S2VKHYV5qPwqcCwoyo9OIw+2lDqqaTPUxYoBCE='} 2024-02-17T23:02:50.573 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-02-17T23:02:50.578 INFO:teuthology.task.internal:roles: ubuntu@smithi005.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-02-17T23:02:50.578 INFO:teuthology.task.internal:roles: ubuntu@smithi080.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-02-17T23:02:50.578 INFO:teuthology.run_tasks:Running task console_log... 2024-02-17T23:02:50.654 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc3db82b0d0>, signals=[15]) 2024-02-17T23:02:50.654 INFO:teuthology.run_tasks:Running task internal.connect... 2024-02-17T23:02:50.685 INFO:teuthology.task.internal:Opening connections... 2024-02-17T23:02:50.685 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi005.front.sepia.ceph.com 2024-02-17T23:02:50.687 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T23:02:50.764 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi080.front.sepia.ceph.com 2024-02-17T23:02:50.765 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T23:02:50.835 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-02-17T23:02:50.841 DEBUG:teuthology.orchestra.run.smithi005:> uname -m 2024-02-17T23:02:50.864 INFO:teuthology.orchestra.run.smithi005.stdout:x86_64 2024-02-17T23:02:50.864 DEBUG:teuthology.orchestra.run.smithi005:> cat /etc/os-release 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:NAME="CentOS Stream" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION="8" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:ID="centos" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:ID_LIKE="rhel fedora" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:VERSION_ID="8" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:PLATFORM_ID="platform:el8" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:ANSI_COLOR="0;31" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:HOME_URL="https://centos.org/" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T23:02:50.925 INFO:teuthology.orchestra.run.smithi005.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T23:02:50.926 INFO:teuthology.lock.ops:Updating smithi005.front.sepia.ceph.com on lock server 2024-02-17T23:02:50.952 DEBUG:teuthology.orchestra.run.smithi080:> uname -m 2024-02-17T23:02:50.974 INFO:teuthology.orchestra.run.smithi080.stdout:x86_64 2024-02-17T23:02:50.974 DEBUG:teuthology.orchestra.run.smithi080:> cat /etc/os-release 2024-02-17T23:02:51.036 INFO:teuthology.orchestra.run.smithi080.stdout:NAME="CentOS Stream" 2024-02-17T23:02:51.036 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION="8" 2024-02-17T23:02:51.036 INFO:teuthology.orchestra.run.smithi080.stdout:ID="centos" 2024-02-17T23:02:51.037 INFO:teuthology.orchestra.run.smithi080.stdout:ID_LIKE="rhel fedora" 2024-02-17T23:02:51.037 INFO:teuthology.orchestra.run.smithi080.stdout:VERSION_ID="8" 2024-02-17T23:02:51.037 INFO:teuthology.orchestra.run.smithi080.stdout:PLATFORM_ID="platform:el8" 2024-02-17T23:02:51.037 INFO:teuthology.orchestra.run.smithi080.stdout:PRETTY_NAME="CentOS Stream 8" 2024-02-17T23:02:51.037 INFO:teuthology.orchestra.run.smithi080.stdout:ANSI_COLOR="0;31" 2024-02-17T23:02:51.037 INFO:teuthology.orchestra.run.smithi080.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-02-17T23:02:51.038 INFO:teuthology.orchestra.run.smithi080.stdout:HOME_URL="https://centos.org/" 2024-02-17T23:02:51.038 INFO:teuthology.orchestra.run.smithi080.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-02-17T23:02:51.038 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-02-17T23:02:51.038 INFO:teuthology.orchestra.run.smithi080.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-02-17T23:02:51.038 INFO:teuthology.lock.ops:Updating smithi080.front.sepia.ceph.com on lock server 2024-02-17T23:02:51.077 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-02-17T23:02:51.090 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-02-17T23:02:51.095 INFO:teuthology.task.internal:Checking for old test directory... 2024-02-17T23:02:51.096 DEBUG:teuthology.orchestra.run.smithi005:> test '!' -e /home/ubuntu/cephtest 2024-02-17T23:02:51.098 DEBUG:teuthology.orchestra.run.smithi080:> test '!' -e /home/ubuntu/cephtest 2024-02-17T23:02:51.118 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-02-17T23:02:51.125 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-02-17T23:02:51.125 DEBUG:teuthology.orchestra.run.smithi005:> test -z $(ls -A /var/lib/ceph) 2024-02-17T23:02:51.160 DEBUG:teuthology.orchestra.run.smithi080:> test -z $(ls -A /var/lib/ceph) 2024-02-17T23:02:51.194 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-02-17T23:02:51.246 INFO:teuthology.run_tasks:Running task kernel... 2024-02-17T23:02:51.261 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-02-17T23:02:51.262 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-02-17T23:02:51.262 DEBUG:teuthology.orchestra.run.smithi005:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-17T23:02:51.262 DEBUG:teuthology.orchestra.run.smithi080:> test -f /run/.containerenv -o -f /.dockerenv 2024-02-17T23:02:51.281 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T23:02:51.282 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-02-17T23:02:51.282 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T23:02:51.283 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-02-17T23:02:51.340 INFO:teuthology.orchestra.run.smithi080.stdout:4.18.0-489.el8.x86_64 2024-02-17T23:02:51.341 INFO:teuthology.task.kernel:Running kernel on smithi080: 4.18.0-489.el8.x86_64 2024-02-17T23:02:51.341 DEBUG:teuthology.orchestra.run.smithi080:> sudo yum install -y kernel 2024-02-17T23:02:51.344 INFO:teuthology.orchestra.run.smithi005.stdout:4.18.0-489.el8.x86_64 2024-02-17T23:02:51.344 INFO:teuthology.task.kernel:Running kernel on smithi005: 4.18.0-489.el8.x86_64 2024-02-17T23:02:51.344 DEBUG:teuthology.orchestra.run.smithi005:> sudo yum install -y kernel 2024-02-17T23:02:56.203 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 8 - AppStream 12 MB/s | 27 MB 00:02 2024-02-17T23:02:56.456 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - AppStream 11 MB/s | 27 MB 00:02 2024-02-17T23:03:01.956 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-02-17T23:03:02.220 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 10 MB 00:00 2024-02-17T23:03:03.948 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - Extras 47 kB/s | 18 kB 00:00 2024-02-17T23:03:04.448 INFO:teuthology.orchestra.run.smithi080.stdout:CentOS Stream 8 - Extras common packages 18 kB/s | 6.9 kB 00:00 2024-02-17T23:03:04.487 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2024-02-17T23:03:04.725 INFO:teuthology.orchestra.run.smithi080.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2024-02-17T23:03:05.130 INFO:teuthology.orchestra.run.smithi005.stdout:CentOS Stream 8 - Extras common packages 13 kB/s | 6.9 kB 00:00 2024-02-17T23:03:05.382 INFO:teuthology.orchestra.run.smithi005.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-02-17T23:03:05.734 INFO:teuthology.orchestra.run.smithi080.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-02-17T23:03:06.876 INFO:teuthology.orchestra.run.smithi005.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-02-17T23:03:09.475 INFO:teuthology.orchestra.run.smithi080.stdout:lab-extras 477 kB/s | 24 kB 00:00 2024-02-17T23:03:10.892 INFO:teuthology.orchestra.run.smithi005.stdout:lab-extras 419 kB/s | 24 kB 00:00 2024-02-17T23:03:12.364 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-17T23:03:12.364 INFO:teuthology.orchestra.run.smithi080.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-17T23:03:12.480 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-17T23:03:12.481 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-17T23:03:12.481 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-02-17T23:03:12.481 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-17T23:03:12.481 INFO:teuthology.orchestra.run.smithi080.stdout:Installing: 2024-02-17T23:03:12.481 INFO:teuthology.orchestra.run.smithi080.stdout: kernel x86_64 4.18.0-539.el8 baseos 10 M 2024-02-17T23:03:12.481 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-17T23:03:12.481 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-core x86_64 4.18.0-539.el8 baseos 43 M 2024-02-17T23:03:12.481 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules x86_64 4.18.0-539.el8 baseos 36 M 2024-02-17T23:03:12.482 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:03:12.482 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-17T23:03:12.482 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-17T23:03:12.482 INFO:teuthology.orchestra.run.smithi080.stdout:Install 3 Packages 2024-02-17T23:03:12.482 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:03:12.482 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 90 M 2024-02-17T23:03:12.482 INFO:teuthology.orchestra.run.smithi080.stdout:Installed size: 97 M 2024-02-17T23:03:12.483 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-17T23:03:13.418 INFO:teuthology.orchestra.run.smithi080.stdout:(1/3): kernel-4.18.0-539.el8.x86_64.rpm 14 MB/s | 10 MB 00:00 2024-02-17T23:03:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-02-17T23:03:14.016 INFO:teuthology.orchestra.run.smithi005.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-02-17T23:03:14.139 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-02-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-02-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-02-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-02-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout:Installing: 2024-02-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout: kernel x86_64 4.18.0-539.el8 baseos 10 M 2024-02-17T23:03:14.140 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-02-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-core x86_64 4.18.0-539.el8 baseos 43 M 2024-02-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules x86_64 4.18.0-539.el8 baseos 36 M 2024-02-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-02-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-02-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout:Install 3 Packages 2024-02-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:03:14.141 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 90 M 2024-02-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout:Installed size: 97 M 2024-02-17T23:03:14.142 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-02-17T23:03:14.219 INFO:teuthology.orchestra.run.smithi080.stdout:(2/3): kernel-modules-4.18.0-539.el8.x86_64.rpm 23 MB/s | 36 MB 00:01 2024-02-17T23:03:14.827 INFO:teuthology.orchestra.run.smithi080.stdout:(3/3): kernel-core-4.18.0-539.el8.x86_64.rpm 20 MB/s | 43 MB 00:02 2024-02-17T23:03:14.827 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-17T23:03:14.828 INFO:teuthology.orchestra.run.smithi080.stdout:Total 38 MB/s | 90 MB 00:02 2024-02-17T23:03:15.083 INFO:teuthology.orchestra.run.smithi005.stdout:(1/3): kernel-4.18.0-539.el8.x86_64.rpm 11 MB/s | 10 MB 00:00 2024-02-17T23:03:15.504 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-17T23:03:15.913 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-17T23:03:15.913 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-17T23:03:16.092 INFO:teuthology.orchestra.run.smithi005.stdout:(2/3): kernel-core-4.18.0-539.el8.x86_64.rpm 23 MB/s | 43 MB 00:01 2024-02-17T23:03:16.459 INFO:teuthology.orchestra.run.smithi005.stdout:(3/3): kernel-modules-4.18.0-539.el8.x86_64.rpm 16 MB/s | 36 MB 00:02 2024-02-17T23:03:16.459 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-02-17T23:03:16.459 INFO:teuthology.orchestra.run.smithi005.stdout:Total 39 MB/s | 90 MB 00:02 2024-02-17T23:03:17.157 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-17T23:03:17.174 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-02-17T23:03:17.190 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-17T23:03:17.621 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-02-17T23:03:17.621 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-02-17T23:03:18.921 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-02-17T23:03:18.940 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-02-17T23:03:19.964 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-17T23:03:20.523 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-17T23:03:21.862 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-02-17T23:03:22.402 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-17T23:03:24.088 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-17T23:03:24.494 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-17T23:03:26.137 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 1/3 2024-02-17T23:03:26.535 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-17T23:03:27.931 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-17T23:03:28.333 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : kernel-4.18.0-539.el8.x86_64 3/3 2024-02-17T23:03:30.216 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 2/3 2024-02-17T23:03:30.529 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : kernel-4.18.0-539.el8.x86_64 3/3 2024-02-17T23:03:50.335 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 3/3 2024-02-17T23:03:50.357 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-17T23:03:50.730 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: kernel-4.18.0-539.el8.x86_64 3/3 2024-02-17T23:03:50.731 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-4.18.0-539.el8.x86_64 1/3 2024-02-17T23:03:50.731 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-core-4.18.0-539.el8.x86_64 2/3 2024-02-17T23:03:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-17T23:03:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:03:51.269 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-17T23:03:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-4.18.0-539.el8.x86_64 kernel-core-4.18.0-539.el8.x86_64 2024-02-17T23:03:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: kernel-modules-4.18.0-539.el8.x86_64 2024-02-17T23:03:51.269 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:03:51.269 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-17T23:03:51.446 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T23:03:51.665 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-17T23:03:51.665 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-17T23:03:51.665 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-539.el8.x86_64 2024-02-17T23:03:51.666 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-17T23:03:51.666 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-17T23:03:51.666 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-02-17T23:03:51.666 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi080.front.sepia.ceph.com, path=None, version=distro) 2024-02-17T23:03:51.666 DEBUG:teuthology.orchestra.run.smithi080:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T23:03:51.875 INFO:teuthology.orchestra.run.smithi080.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-17T23:03:51.875 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-17T23:03:51.876 DEBUG:teuthology.orchestra.run.smithi080:> sudo rpm -qi grub2-tools 2024-02-17T23:03:51.910 INFO:teuthology.orchestra.run.smithi080.stdout:Name : grub2-tools 2024-02-17T23:03:51.910 INFO:teuthology.orchestra.run.smithi080.stdout:Epoch : 1 2024-02-17T23:03:51.910 INFO:teuthology.orchestra.run.smithi080.stdout:Version : 2.02 2024-02-17T23:03:51.910 INFO:teuthology.orchestra.run.smithi080.stdout:Release : 129.el8 2024-02-17T23:03:51.910 INFO:teuthology.orchestra.run.smithi080.stdout:Architecture: x86_64 2024-02-17T23:03:51.910 INFO:teuthology.orchestra.run.smithi080.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-17T23:03:51.911 INFO:teuthology.orchestra.run.smithi080.stdout:Group : System Environment/Base 2024-02-17T23:03:51.911 INFO:teuthology.orchestra.run.smithi080.stdout:Size : 9265586 2024-02-17T23:03:51.911 INFO:teuthology.orchestra.run.smithi080.stdout:License : GPLv3+ 2024-02-17T23:03:51.911 INFO:teuthology.orchestra.run.smithi080.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-17T23:03:51.911 INFO:teuthology.orchestra.run.smithi080.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-17T23:03:51.911 INFO:teuthology.orchestra.run.smithi080.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout:Relocations : (not relocatable) 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout:Packager : CentOS BuildSystem 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout:Vendor : CentOS 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout:Summary : Support tools for GRUB. 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout:Description : 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-17T23:03:51.912 INFO:teuthology.orchestra.run.smithi080.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-17T23:03:51.913 INFO:teuthology.orchestra.run.smithi080.stdout:hardware devices. 2024-02-17T23:03:51.913 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:03:51.913 INFO:teuthology.orchestra.run.smithi080.stdout:This subpackage provides tools for support of all platforms. 2024-02-17T23:03:51.913 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-17T23:03:51.914 INFO:teuthology.task.kernel:Updating grub on smithi080 to boot 4.18.0-539.el8.x86_64 2024-02-17T23:03:51.914 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-17T23:03:53.486 INFO:teuthology.orchestra.run.smithi080.stderr:Generating grub configuration file ... 2024-02-17T23:03:53.963 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-core-4.18.0-539.el8.x86_64 3/3 2024-02-17T23:03:53.988 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-17T23:03:54.360 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: kernel-4.18.0-539.el8.x86_64 3/3 2024-02-17T23:03:54.360 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-4.18.0-539.el8.x86_64 1/3 2024-02-17T23:03:54.360 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-core-4.18.0-539.el8.x86_64 2/3 2024-02-17T23:03:54.806 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : kernel-modules-4.18.0-539.el8.x86_64 3/3 2024-02-17T23:03:54.806 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:03:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-02-17T23:03:54.806 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-4.18.0-539.el8.x86_64 kernel-core-4.18.0-539.el8.x86_64 2024-02-17T23:03:54.806 INFO:teuthology.orchestra.run.smithi005.stdout: kernel-modules-4.18.0-539.el8.x86_64 2024-02-17T23:03:54.806 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:03:54.806 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-02-17T23:03:54.977 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T23:03:55.204 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-17T23:03:55.204 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-17T23:03:55.204 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-539.el8.x86_64 2024-02-17T23:03:55.204 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-02-17T23:03:55.204 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-02-17T23:03:55.204 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-02-17T23:03:55.205 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi005.front.sepia.ceph.com, path=None, version=distro) 2024-02-17T23:03:55.205 DEBUG:teuthology.orchestra.run.smithi005:> rpm -q kernel | sort -rV | head -n 1 2024-02-17T23:03:55.421 INFO:teuthology.orchestra.run.smithi080.stderr:done 2024-02-17T23:03:55.423 DEBUG:teuthology.orchestra.run.smithi080:> mktemp 2024-02-17T23:03:55.424 INFO:teuthology.orchestra.run.smithi005.stdout:kernel-4.18.0-539.el8.x86_64 2024-02-17T23:03:55.425 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-539.el8.x86_64 2024-02-17T23:03:55.425 DEBUG:teuthology.orchestra.run.smithi005:> sudo rpm -qi grub2-tools 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Name : grub2-tools 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Epoch : 1 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Version : 2.02 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Release : 129.el8 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Architecture: x86_64 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Group : System Environment/Base 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Size : 9265586 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:License : GPLv3+ 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-02-17T23:03:55.460 INFO:teuthology.orchestra.run.smithi005.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:Build Host : kbuilder.bsys.centos.org 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:Relocations : (not relocatable) 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:Packager : CentOS BuildSystem 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:Vendor : CentOS 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:URL : http://www.gnu.org/software/grub/ 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:Summary : Support tools for GRUB. 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:Description : 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:customizable bootloader with modular architecture. It supports a rich 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:variety of kernel formats, file systems, computer architectures and 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:hardware devices. 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:03:55.461 INFO:teuthology.orchestra.run.smithi005.stdout:This subpackage provides tools for support of all platforms. 2024-02-17T23:03:55.462 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-02-17T23:03:55.462 INFO:teuthology.task.kernel:Updating grub on smithi005 to boot 4.18.0-539.el8.x86_64 2024-02-17T23:03:55.462 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-02-17T23:03:55.465 INFO:teuthology.orchestra.run.smithi080.stdout:/tmp/tmp.JMOHZGNuzZ 2024-02-17T23:03:55.465 DEBUG:teuthology.orchestra.run.smithi080:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JMOHZGNuzZ 2024-02-17T23:03:55.552 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0666 /tmp/tmp.JMOHZGNuzZ 2024-02-17T23:03:55.663 DEBUG:teuthology.orchestra.remote:smithi080:/tmp/tmp.JMOHZGNuzZ is 6KB 2024-02-17T23:03:55.711 DEBUG:teuthology.orchestra.run.smithi080:> rm -fr /tmp/tmp.JMOHZGNuzZ 2024-02-17T23:03:55.729 DEBUG:teuthology.orchestra.run.smithi080:> sudo /bin/ls /boot/loader/entries || true 2024-02-17T23:03:55.802 INFO:teuthology.orchestra.run.smithi080.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-17T23:03:55.802 INFO:teuthology.orchestra.run.smithi080.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-17T23:03:55.803 INFO:teuthology.orchestra.run.smithi080.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-17T23:03:55.803 INFO:teuthology.orchestra.run.smithi080.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64.conf 2024-02-17T23:03:55.804 DEBUG:teuthology.orchestra.run.smithi080:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64 2024-02-17T23:03:55.985 DEBUG:teuthology.orchestra.run.smithi080:> sudo shutdown -r now 2024-02-17T23:03:57.141 INFO:teuthology.orchestra.run.smithi005.stderr:Generating grub configuration file ... 2024-02-17T23:03:59.072 INFO:teuthology.orchestra.run.smithi005.stderr:done 2024-02-17T23:03:59.074 DEBUG:teuthology.orchestra.run.smithi005:> mktemp 2024-02-17T23:03:59.095 INFO:teuthology.orchestra.run.smithi005.stdout:/tmp/tmp.xAHAfFszDk 2024-02-17T23:03:59.095 DEBUG:teuthology.orchestra.run.smithi005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.xAHAfFszDk 2024-02-17T23:03:59.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0666 /tmp/tmp.xAHAfFszDk 2024-02-17T23:03:59.309 DEBUG:teuthology.orchestra.remote:smithi005:/tmp/tmp.xAHAfFszDk is 6KB 2024-02-17T23:03:59.357 DEBUG:teuthology.orchestra.run.smithi005:> rm -fr /tmp/tmp.xAHAfFszDk 2024-02-17T23:03:59.375 DEBUG:teuthology.orchestra.run.smithi005:> sudo /bin/ls /boot/loader/entries || true 2024-02-17T23:03:59.444 INFO:teuthology.orchestra.run.smithi005.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-02-17T23:03:59.444 INFO:teuthology.orchestra.run.smithi005.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-02-17T23:03:59.444 INFO:teuthology.orchestra.run.smithi005.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-02-17T23:03:59.444 INFO:teuthology.orchestra.run.smithi005.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64.conf 2024-02-17T23:03:59.445 DEBUG:teuthology.orchestra.run.smithi005:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-539.el8.x86_64 2024-02-17T23:03:59.669 DEBUG:teuthology.orchestra.run.smithi005:> sudo shutdown -r now 2024-02-17T23:04:26.012 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-02-17T23:04:26.013 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-17T23:04:26.014 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T23:04:29.672 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-02-17T23:04:29.672 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-02-17T23:04:29.673 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T23:04:44.348 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-17T23:04:48.188 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.5 2024-02-17T23:04:53.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-17T23:04:53.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T23:04:56.412 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.80 2024-02-17T23:04:57.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-02-17T23:04:57.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T23:05:08.423 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-17T23:05:08.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T23:05:40.976 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-02-17T23:05:41.347 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-17T23:05:41.347 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "4.18.0-539.el8.x86_64"... 2024-02-17T23:05:41.347 DEBUG:teuthology.orchestra.run.smithi080:> uname -r 2024-02-17T23:05:41.366 INFO:teuthology.orchestra.run.smithi080.stdout:4.18.0-539.el8.x86_64 2024-02-17T23:05:41.366 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-539.el8.x86_64 vs 4.18.0-539.el8.x86_64 2024-02-17T23:05:41.366 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-17T23:05:41.367 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-17T23:05:42.367 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-02-17T23:05:42.367 DEBUG:teuthology.orchestra.run.smithi080:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-17T23:05:42.436 INFO:teuthology.orchestra.run.smithi080.stdout:ttyS1 2024-02-17T23:05:42.449 DEBUG:teuthology.parallel:result is None 2024-02-17T23:05:57.194 DEBUG:teuthology.orchestra.remote:timed out 2024-02-17T23:06:09.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-02-17T23:06:09.196 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T23:06:09.623 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-02-17T23:06:09.971 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-02-17T23:06:09.971 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-539.el8.x86_64"... 2024-02-17T23:06:09.971 DEBUG:teuthology.orchestra.run.smithi005:> uname -r 2024-02-17T23:06:09.992 INFO:teuthology.orchestra.run.smithi005.stdout:4.18.0-539.el8.x86_64 2024-02-17T23:06:09.992 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-539.el8.x86_64 vs 4.18.0-539.el8.x86_64 2024-02-17T23:06:09.992 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-02-17T23:06:09.993 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-02-17T23:06:10.994 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-02-17T23:06:10.994 DEBUG:teuthology.orchestra.run.smithi005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-02-17T23:06:11.073 INFO:teuthology.orchestra.run.smithi005.stdout:ttyS1 2024-02-17T23:06:11.089 DEBUG:teuthology.parallel:result is None 2024-02-17T23:06:11.089 INFO:teuthology.run_tasks:Running task internal.base... 2024-02-17T23:06:11.104 INFO:teuthology.task.internal:Creating test directory... 2024-02-17T23:06:11.105 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-17T23:06:11.108 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-02-17T23:06:11.132 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-02-17T23:06:11.141 INFO:teuthology.run_tasks:Running task internal.archive... 2024-02-17T23:06:11.151 INFO:teuthology.task.internal:Creating archive directory... 2024-02-17T23:06:11.217 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-17T23:06:11.220 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-02-17T23:06:11.281 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-02-17T23:06:11.292 INFO:teuthology.task.internal:Enabling coredump saving... 2024-02-17T23:06:11.292 DEBUG:teuthology.orchestra.run.smithi005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-17T23:06:11.299 DEBUG:teuthology.orchestra.run.smithi080:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-02-17T23:06:11.341 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T23:06:11.342 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T23:06:11.353 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T23:06:11.353 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-02-17T23:06:11.355 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-02-17T23:06:11.364 INFO:teuthology.task.internal:Configuring sudo... 2024-02-17T23:06:11.364 DEBUG:teuthology.orchestra.run.smithi005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-17T23:06:11.367 DEBUG:teuthology.orchestra.run.smithi080:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-02-17T23:06:11.429 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-02-17T23:06:11.439 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-02-17T23:06:11.439 DEBUG:teuthology.orchestra.run.smithi005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-17T23:06:11.442 DEBUG:teuthology.orchestra.run.smithi080:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-02-17T23:06:11.492 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T23:06:11.546 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T23:06:11.598 DEBUG:teuthology.orchestra.run.smithi005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T23:06:11.684 DEBUG:teuthology.orchestra.run.smithi005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T23:06:11.729 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-02-17T23:06:11.729 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-17T23:06:11.797 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T23:06:11.847 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-02-17T23:06:11.903 DEBUG:teuthology.orchestra.run.smithi080:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T23:06:11.990 DEBUG:teuthology.orchestra.run.smithi080:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-02-17T23:06:12.034 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-17T23:06:12.034 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-02-17T23:06:12.103 DEBUG:teuthology.orchestra.run.smithi005:> sudo service rsyslog restart 2024-02-17T23:06:12.105 DEBUG:teuthology.orchestra.run.smithi080:> sudo service rsyslog restart 2024-02-17T23:06:12.166 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T23:06:12.226 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T23:06:12.652 INFO:teuthology.run_tasks:Running task internal.timer... 2024-02-17T23:06:12.661 INFO:teuthology.task.internal:Starting timer... 2024-02-17T23:06:12.661 INFO:teuthology.run_tasks:Running task pcp... 2024-02-17T23:06:12.671 INFO:teuthology.run_tasks:Running task selinux... 2024-02-17T23:06:12.681 DEBUG:teuthology.orchestra.run.smithi005:> sudo service auditd rotate 2024-02-17T23:06:12.781 INFO:teuthology.orchestra.run.smithi005.stdout:Rotating logs: 2024-02-17T23:06:12.783 DEBUG:teuthology.orchestra.run.smithi080:> sudo service auditd rotate 2024-02-17T23:06:12.862 INFO:teuthology.orchestra.run.smithi080.stdout:Rotating logs: 2024-02-17T23:06:12.864 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-02-17T23:06:12.864 DEBUG:teuthology.orchestra.run.smithi005:> /usr/sbin/getenforce 2024-02-17T23:06:12.913 INFO:teuthology.orchestra.run.smithi005.stdout:Permissive 2024-02-17T23:06:12.914 DEBUG:teuthology.orchestra.run.smithi080:> /usr/sbin/getenforce 2024-02-17T23:06:12.963 INFO:teuthology.orchestra.run.smithi080.stdout:Permissive 2024-02-17T23:06:12.964 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi005.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi080.front.sepia.ceph.com': 'permissive'} 2024-02-17T23:06:12.964 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T23:06:12.994 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T23:06:12.995 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T23:06:13.022 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T23:06:13.023 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-02-17T23:06:13.023 DEBUG:teuthology.orchestra.run.smithi005:> sudo /usr/sbin/setenforce permissive 2024-02-17T23:06:13.067 DEBUG:teuthology.orchestra.run.smithi080:> sudo /usr/sbin/setenforce permissive 2024-02-17T23:06:13.095 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-02-17T23:06:13.105 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-02-17T23:06:13.121 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-02-17T23:06:13.123 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi005.front.sepia.ceph.com,smithi080.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-02-17T23:12:08.172 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi005.front.sepia.ceph.com'), Remote(name='ubuntu@smithi080.front.sepia.ceph.com')] 2024-02-17T23:12:08.173 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-02-17T23:12:08.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T23:12:08.250 DEBUG:teuthology.orchestra.run.smithi005:> true 2024-02-17T23:12:08.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi005.front.sepia.ceph.com' 2024-02-17T23:12:08.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-17T23:12:08.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi080.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-02-17T23:12:08.394 DEBUG:teuthology.orchestra.run.smithi080:> true 2024-02-17T23:12:08.464 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi080.front.sepia.ceph.com' 2024-02-17T23:12:08.464 INFO:teuthology.run_tasks:Running task clock... 2024-02-17T23:12:08.476 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-02-17T23:12:08.476 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-17T23:12:08.476 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T23:12:08.479 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-02-17T23:12:08.479 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T23:12:08.512 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-17T23:12:08.527 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-17T23:12:08.537 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-02-17T23:12:08.551 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-02-17T23:12:08.594 INFO:teuthology.orchestra.run.smithi005.stderr:sudo: ntpd: command not found 2024-02-17T23:12:08.606 INFO:teuthology.orchestra.run.smithi005.stdout:506 Cannot talk to daemon 2024-02-17T23:12:08.621 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-17T23:12:08.622 INFO:teuthology.orchestra.run.smithi080.stderr:sudo: ntpd: command not found 2024-02-17T23:12:08.632 INFO:teuthology.orchestra.run.smithi080.stdout:506 Cannot talk to daemon 2024-02-17T23:12:08.635 INFO:teuthology.orchestra.run.smithi005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-17T23:12:08.646 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-02-17T23:12:08.659 INFO:teuthology.orchestra.run.smithi080.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-02-17T23:12:08.702 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2024-02-17T23:12:08.707 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T23:12:08.707 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-02-17T23:12:08.707 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T23:12:08.708 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T23:12:08.708 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T23:12:08.708 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T23:12:08.728 INFO:teuthology.orchestra.run.smithi080.stderr:bash: ntpq: command not found 2024-02-17T23:12:08.731 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T23:12:08.731 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-02-17T23:12:08.731 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T23:12:08.732 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T23:12:08.732 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T23:12:08.732 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T23:12:08.737 INFO:teuthology.run_tasks:Running task pexec... 2024-02-17T23:12:08.746 INFO:teuthology.task.pexec:Executing custom commands... 2024-02-17T23:12:08.746 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi005.front.sepia.ceph.com 2024-02-17T23:12:08.746 DEBUG:teuthology.orchestra.run.smithi005:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-17T23:12:08.747 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi080.front.sepia.ceph.com 2024-02-17T23:12:08.747 DEBUG:teuthology.orchestra.run.smithi080:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-02-17T23:12:09.563 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:30 ago on Sat 17 Feb 2024 11:10:39 PM UTC. 2024-02-17T23:12:09.570 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:23 ago on Sat 17 Feb 2024 11:10:46 PM UTC. 2024-02-17T23:12:11.514 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-17T23:12:11.515 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-17T23:12:11.515 INFO:teuthology.orchestra.run.smithi080.stdout: Package Architecture Version Repository Size 2024-02-17T23:12:11.515 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-17T23:12:11.515 INFO:teuthology.orchestra.run.smithi080.stdout:Resetting modules: 2024-02-17T23:12:11.515 INFO:teuthology.orchestra.run.smithi080.stdout: container-tools 2024-02-17T23:12:11.515 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:12:11.515 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-17T23:12:11.515 INFO:teuthology.orchestra.run.smithi080.stdout:================================================================================ 2024-02-17T23:12:11.515 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:12:11.739 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-02-17T23:12:11.741 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-02-17T23:12:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: Package Architecture Version Repository Size 2024-02-17T23:12:11.741 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-02-17T23:12:11.741 INFO:teuthology.orchestra.run.smithi005.stdout:Resetting modules: 2024-02-17T23:12:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools 2024-02-17T23:12:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:12:11.741 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-02-17T23:12:11.741 INFO:teuthology.orchestra.run.smithi005.stdout:================================================================================ 2024-02-17T23:12:11.741 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:12:11.754 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-17T23:12:12.007 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-02-17T23:12:12.644 INFO:teuthology.orchestra.run.smithi080.stdout:Last metadata expiration check: 0:01:33 ago on Sat 17 Feb 2024 11:10:39 PM UTC. 2024-02-17T23:12:12.895 INFO:teuthology.orchestra.run.smithi005.stdout:Last metadata expiration check: 0:01:26 ago on Sat 17 Feb 2024 11:10:46 PM UTC. 2024-02-17T23:12:14.676 INFO:teuthology.orchestra.run.smithi080.stdout:Dependencies resolved. 2024-02-17T23:12:14.679 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================================ 2024-02-17T23:12:14.679 INFO:teuthology.orchestra.run.smithi080.stdout: Package Arch Version Repo Size 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================================ 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrading: 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: conmon x86_64 3:2.1.10-1.module_el8+804+f131391c appstream 58 k 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: container-selinux noarch 2:2.229.0-2.module_el8+847+7863d4e6 appstream 71 k 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: containernetworking-plugins x86_64 1:1.4.0-1.module_el8+804+f131391c appstream 22 M 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: containers-common x86_64 2:1-58.module_el8+804+f131391c appstream 148 k 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: criu x86_64 3.18-4.module_el8+804+f131391c appstream 564 k 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-overlayfs x86_64 1.13-1.module_el8+804+f131391c appstream 70 k 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: libslirp x86_64 4.4.0-1.module_el8+804+f131391c appstream 70 k 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: runc x86_64 1:1.1.12-1.module_el8+885+7da147f3 appstream 3.1 M 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: slirp4netns x86_64 1.2.2-1.module_el8+804+f131391c appstream 56 k 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout:Installing group/module packages: 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-17T23:12:14.680 INFO:teuthology.orchestra.run.smithi080.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: crun x86_64 1.14-1.module_el8+871+552be958 appstream 257 k 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: netavark x86_64 2:1.10.2-1.module_el8+885+7da147f3 appstream 4.3 M 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout:Installing dependencies: 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout:Installing weak dependencies: 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: criu-libs x86_64 3.18-4.module_el8+804+f131391c appstream 39 k 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout:Installing module profiles: 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout: container-tools/common 2024-02-17T23:12:14.681 INFO:teuthology.orchestra.run.smithi080.stdout:Enabling module streams: 2024-02-17T23:12:14.682 INFO:teuthology.orchestra.run.smithi080.stdout: container-tools rhel8 2024-02-17T23:12:14.682 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:12:14.682 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction Summary 2024-02-17T23:12:14.682 INFO:teuthology.orchestra.run.smithi080.stdout:============================================================================================ 2024-02-17T23:12:14.682 INFO:teuthology.orchestra.run.smithi080.stdout:Install 13 Packages 2024-02-17T23:12:14.682 INFO:teuthology.orchestra.run.smithi080.stdout:Upgrade 9 Packages 2024-02-17T23:12:14.682 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:12:14.682 INFO:teuthology.orchestra.run.smithi080.stdout:Total download size: 54 M 2024-02-17T23:12:14.682 INFO:teuthology.orchestra.run.smithi080.stdout:Downloading Packages: 2024-02-17T23:12:15.080 INFO:teuthology.orchestra.run.smithi005.stdout:Dependencies resolved. 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================ 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout: Package Arch Version Repo Size 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================ 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrading: 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout: conmon x86_64 3:2.1.10-1.module_el8+804+f131391c appstream 58 k 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout: container-selinux noarch 2:2.229.0-2.module_el8+847+7863d4e6 appstream 71 k 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout: containernetworking-plugins x86_64 1:1.4.0-1.module_el8+804+f131391c appstream 22 M 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout: containers-common x86_64 2:1-58.module_el8+804+f131391c appstream 148 k 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout: criu x86_64 3.18-4.module_el8+804+f131391c appstream 564 k 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-overlayfs x86_64 1.13-1.module_el8+804+f131391c appstream 70 k 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout: libslirp x86_64 4.4.0-1.module_el8+804+f131391c appstream 70 k 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout: runc x86_64 1:1.1.12-1.module_el8+885+7da147f3 appstream 3.1 M 2024-02-17T23:12:15.084 INFO:teuthology.orchestra.run.smithi005.stdout: slirp4netns x86_64 1.2.2-1.module_el8+804+f131391c appstream 56 k 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout:Installing group/module packages: 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: buildah x86_64 2:1.33.5-1.module_el8+885+7da147f3 appstream 9.7 M 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: cockpit-podman noarch 83-1.module_el8+847+7863d4e6 appstream 688 k 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: crun x86_64 1.14-1.module_el8+871+552be958 appstream 257 k 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: netavark x86_64 2:1.10.2-1.module_el8+885+7da147f3 appstream 4.3 M 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: toolbox x86_64 0.0.99.5-1.module_el8+847+7863d4e6 appstream 2.5 M 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout:Installing dependencies: 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout:Installing weak dependencies: 2024-02-17T23:12:15.085 INFO:teuthology.orchestra.run.smithi005.stdout: criu-libs x86_64 3.18-4.module_el8+804+f131391c appstream 39 k 2024-02-17T23:12:15.086 INFO:teuthology.orchestra.run.smithi005.stdout:Installing module profiles: 2024-02-17T23:12:15.086 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools/common 2024-02-17T23:12:15.086 INFO:teuthology.orchestra.run.smithi005.stdout:Enabling module streams: 2024-02-17T23:12:15.086 INFO:teuthology.orchestra.run.smithi005.stdout: container-tools rhel8 2024-02-17T23:12:15.086 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:12:15.086 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction Summary 2024-02-17T23:12:15.086 INFO:teuthology.orchestra.run.smithi005.stdout:============================================================================================ 2024-02-17T23:12:15.086 INFO:teuthology.orchestra.run.smithi005.stdout:Install 13 Packages 2024-02-17T23:12:15.086 INFO:teuthology.orchestra.run.smithi005.stdout:Upgrade 9 Packages 2024-02-17T23:12:15.086 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:12:15.087 INFO:teuthology.orchestra.run.smithi005.stdout:Total download size: 54 M 2024-02-17T23:12:15.087 INFO:teuthology.orchestra.run.smithi005.stdout:Downloading Packages: 2024-02-17T23:12:15.126 INFO:teuthology.orchestra.run.smithi080.stdout:(1/22): cockpit-podman-83-1.module_el8+847+7863 2.6 MB/s | 688 kB 00:00 2024-02-17T23:12:15.159 INFO:teuthology.orchestra.run.smithi080.stdout:(2/22): aardvark-dns-1.10.0-1.module_el8+871+55 3.5 MB/s | 1.0 MB 00:00 2024-02-17T23:12:15.184 INFO:teuthology.orchestra.run.smithi080.stdout:(3/22): criu-libs-3.18-4.module_el8+804+f131391 672 kB/s | 39 kB 00:00 2024-02-17T23:12:15.218 INFO:teuthology.orchestra.run.smithi080.stdout:(4/22): crun-1.14-1.module_el8+871+552be958.x86 4.3 MB/s | 257 kB 00:00 2024-02-17T23:12:15.285 INFO:teuthology.orchestra.run.smithi080.stdout:(5/22): python3-podman-4.9.0-1.module_el8+847+7 2.6 MB/s | 180 kB 00:00 2024-02-17T23:12:15.352 INFO:teuthology.orchestra.run.smithi080.stdout:(6/22): python3-pytoml-0.1.14-5.git7dea353.el8. 371 kB/s | 25 kB 00:00 2024-02-17T23:12:15.419 INFO:teuthology.orchestra.run.smithi080.stdout:(7/22): python3-pyxdg-0.25-16.el8.noarch.rpm 1.4 MB/s | 94 kB 00:00 2024-02-17T23:12:15.511 INFO:teuthology.orchestra.run.smithi080.stdout:(8/22): netavark-1.10.2-1.module_el8+885+7da147 13 MB/s | 4.3 MB 00:00 2024-02-17T23:12:15.697 INFO:teuthology.orchestra.run.smithi080.stdout:(9/22): buildah-1.33.5-1.module_el8+885+7da147f 12 MB/s | 9.7 MB 00:00 2024-02-17T23:12:15.754 INFO:teuthology.orchestra.run.smithi080.stdout:(10/22): toolbox-0.0.99.5-1.module_el8+847+7863 10 MB/s | 2.5 MB 00:00 2024-02-17T23:12:15.779 INFO:teuthology.orchestra.run.smithi080.stdout:(11/22): udica-0.2.6-20.module_el8+804+f131391c 628 kB/s | 53 kB 00:00 2024-02-17T23:12:15.813 INFO:teuthology.orchestra.run.smithi080.stdout:(12/22): yajl-2.1.0-12.el8.x86_64.rpm 697 kB/s | 41 kB 00:00 2024-02-17T23:12:15.838 INFO:teuthology.orchestra.run.smithi080.stdout:(13/22): conmon-2.1.10-1.module_el8+804+f131391 988 kB/s | 58 kB 00:00 2024-02-17T23:12:15.839 INFO:teuthology.orchestra.run.smithi005.stdout:(1/22): cockpit-podman-83-1.module_el8+847+7863 1.2 MB/s | 688 kB 00:00 2024-02-17T23:12:15.897 INFO:teuthology.orchestra.run.smithi080.stdout:(14/22): container-selinux-2.229.0-2.module_el8 849 kB/s | 71 kB 00:00 2024-02-17T23:12:15.907 INFO:teuthology.orchestra.run.smithi005.stdout:(2/22): criu-libs-3.18-4.module_el8+804+f131391 574 kB/s | 39 kB 00:00 2024-02-17T23:12:15.964 INFO:teuthology.orchestra.run.smithi080.stdout:(15/22): containers-common-1-58.module_el8+804+ 2.2 MB/s | 148 kB 00:00 2024-02-17T23:12:15.975 INFO:teuthology.orchestra.run.smithi005.stdout:(3/22): crun-1.14-1.module_el8+871+552be958.x86 3.8 MB/s | 257 kB 00:00 2024-02-17T23:12:16.039 INFO:teuthology.orchestra.run.smithi080.stdout:(16/22): criu-3.18-4.module_el8+804+f131391c.x8 7.3 MB/s | 564 kB 00:00 2024-02-17T23:12:16.116 INFO:teuthology.orchestra.run.smithi005.stdout:(4/22): aardvark-dns-1.10.0-1.module_el8+871+55 1.2 MB/s | 1.0 MB 00:00 2024-02-17T23:12:16.199 INFO:teuthology.orchestra.run.smithi080.stdout:(17/22): skopeo-1.14.3-0.1.module_el8+885+7da14 11 MB/s | 8.8 MB 00:00 2024-02-17T23:12:16.231 INFO:teuthology.orchestra.run.smithi080.stdout:(18/22): fuse-overlayfs-1.13-1.module_el8+804+f 364 kB/s | 70 kB 00:00 2024-02-17T23:12:16.242 INFO:teuthology.orchestra.run.smithi005.stdout:(5/22): python3-podman-4.9.0-1.module_el8+847+7 1.4 MB/s | 180 kB 00:00 2024-02-17T23:12:16.265 INFO:teuthology.orchestra.run.smithi080.stdout:(19/22): libslirp-4.4.0-1.module_el8+804+f13139 1.0 MB/s | 70 kB 00:00 2024-02-17T23:12:16.317 INFO:teuthology.orchestra.run.smithi005.stdout:(6/22): netavark-1.10.2-1.module_el8+885+7da147 13 MB/s | 4.3 MB 00:00 2024-02-17T23:12:16.324 INFO:teuthology.orchestra.run.smithi080.stdout:(20/22): slirp4netns-1.2.2-1.module_el8+804+f13 955 kB/s | 56 kB 00:00 2024-02-17T23:12:16.342 INFO:teuthology.orchestra.run.smithi005.stdout:(7/22): python3-pytoml-0.1.14-5.git7dea353.el8. 247 kB/s | 25 kB 00:00 2024-02-17T23:12:16.451 INFO:teuthology.orchestra.run.smithi005.stdout:(8/22): buildah-1.33.5-1.module_el8+885+7da147f 8.3 MB/s | 9.7 MB 00:01 2024-02-17T23:12:16.468 INFO:teuthology.orchestra.run.smithi005.stdout:(9/22): python3-pyxdg-0.25-16.el8.noarch.rpm 624 kB/s | 94 kB 00:00 2024-02-17T23:12:16.482 INFO:teuthology.orchestra.run.smithi080.stdout:(21/22): runc-1.1.12-1.module_el8+885+7da147f3. 13 MB/s | 3.1 MB 00:00 2024-02-17T23:12:16.518 INFO:teuthology.orchestra.run.smithi005.stdout:(10/22): udica-0.2.6-20.module_el8+804+f131391c 1.0 MB/s | 53 kB 00:00 2024-02-17T23:12:16.577 INFO:teuthology.orchestra.run.smithi005.stdout:(11/22): yajl-2.1.0-12.el8.x86_64.rpm 701 kB/s | 41 kB 00:00 2024-02-17T23:12:16.660 INFO:teuthology.orchestra.run.smithi005.stdout:(12/22): toolbox-0.0.99.5-1.module_el8+847+7863 12 MB/s | 2.5 MB 00:00 2024-02-17T23:12:16.714 INFO:teuthology.orchestra.run.smithi005.stdout:(13/22): conmon-2.1.10-1.module_el8+804+f131391 426 kB/s | 58 kB 00:00 2024-02-17T23:12:16.736 INFO:teuthology.orchestra.run.smithi005.stdout:(14/22): container-selinux-2.229.0-2.module_el8 942 kB/s | 71 kB 00:00 2024-02-17T23:12:16.795 INFO:teuthology.orchestra.run.smithi005.stdout:(15/22): containers-common-1-58.module_el8+804+ 2.5 MB/s | 148 kB 00:00 2024-02-17T23:12:16.862 INFO:teuthology.orchestra.run.smithi005.stdout:(16/22): criu-3.18-4.module_el8+804+f131391c.x8 8.3 MB/s | 564 kB 00:00 2024-02-17T23:12:16.920 INFO:teuthology.orchestra.run.smithi005.stdout:(17/22): fuse-overlayfs-1.13-1.module_el8+804+f 1.2 MB/s | 70 kB 00:00 2024-02-17T23:12:16.949 INFO:teuthology.orchestra.run.smithi080.stdout:(22/22): containernetworking-plugins-1.4.0-1.mo 20 MB/s | 22 MB 00:01 2024-02-17T23:12:16.950 INFO:teuthology.orchestra.run.smithi080.stdout:-------------------------------------------------------------------------------- 2024-02-17T23:12:16.950 INFO:teuthology.orchestra.run.smithi080.stdout:Total 24 MB/s | 54 MB 00:02 2024-02-17T23:12:16.979 INFO:teuthology.orchestra.run.smithi005.stdout:(18/22): libslirp-4.4.0-1.module_el8+804+f13139 1.2 MB/s | 70 kB 00:00 2024-02-17T23:12:17.204 INFO:teuthology.orchestra.run.smithi005.stdout:(19/22): runc-1.1.12-1.module_el8+885+7da147f3. 14 MB/s | 3.1 MB 00:00 2024-02-17T23:12:17.271 INFO:teuthology.orchestra.run.smithi005.stdout:(20/22): slirp4netns-1.2.2-1.module_el8+804+f13 841 kB/s | 56 kB 00:00 2024-02-17T23:12:17.446 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction check 2024-02-17T23:12:17.492 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction check succeeded. 2024-02-17T23:12:17.492 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction test 2024-02-17T23:12:17.797 INFO:teuthology.orchestra.run.smithi005.stdout:(21/22): containernetworking-plugins-1.4.0-1.mo 20 MB/s | 22 MB 00:01 2024-02-17T23:12:17.978 INFO:teuthology.orchestra.run.smithi080.stdout:Transaction test succeeded. 2024-02-17T23:12:17.981 INFO:teuthology.orchestra.run.smithi080.stdout:Running transaction 2024-02-17T23:12:19.297 INFO:teuthology.orchestra.run.smithi080.stdout: Preparing : 1/1 2024-02-17T23:12:19.309 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d4e 1/1 2024-02-17T23:12:19.335 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-17T23:12:19.570 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-17T23:12:19.647 INFO:teuthology.orchestra.run.smithi005.stdout:(22/22): skopeo-1.14.3-0.1.module_el8+885+7da14 2.7 MB/s | 8.8 MB 00:03 2024-02-17T23:12:19.647 INFO:teuthology.orchestra.run.smithi005.stdout:-------------------------------------------------------------------------------- 2024-02-17T23:12:19.648 INFO:teuthology.orchestra.run.smithi005.stdout:Total 12 MB/s | 54 MB 00:04 2024-02-17T23:12:20.164 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction check 2024-02-17T23:12:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction check succeeded. 2024-02-17T23:12:20.213 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction test 2024-02-17T23:12:20.758 INFO:teuthology.orchestra.run.smithi005.stdout:Transaction test succeeded. 2024-02-17T23:12:20.761 INFO:teuthology.orchestra.run.smithi005.stdout:Running transaction 2024-02-17T23:12:22.065 INFO:teuthology.orchestra.run.smithi005.stdout: Preparing : 1/1 2024-02-17T23:12:22.077 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d4e 1/1 2024-02-17T23:12:22.119 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-17T23:12:22.381 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-17T23:12:37.967 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-17T23:12:38.515 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : criu-3.18-4.module_el8+804+f131391c.x86_64 2/31 2024-02-17T23:12:38.778 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 3/31 2024-02-17T23:12:38.951 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-17T23:12:39.139 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 5/31 2024-02-17T23:12:39.374 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 6/31 2024-02-17T23:12:39.532 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-17T23:12:41.378 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-17T23:12:41.473 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 1/31 2024-02-17T23:12:41.631 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : containernetworking-plugins-1:1.4.0-1.module_el8+8 8/31 2024-02-17T23:12:41.861 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : yajl-2.1.0-12.el8.x86_64 9/31 2024-02-17T23:12:42.032 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : crun-1.14-1.module_el8+871+552be958.x86_64 10/31 2024-02-17T23:12:42.045 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : criu-3.18-4.module_el8+804+f131391c.x86_64 2/31 2024-02-17T23:12:42.249 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 3/31 2024-02-17T23:12:42.430 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-17T23:12:42.594 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 5/31 2024-02-17T23:12:42.812 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 6/31 2024-02-17T23:12:42.978 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-17T23:12:43.008 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : containers-common-2:1-58.module_el8+804+f131391c.x 11/31 2024-02-17T23:12:43.227 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 12/31 2024-02-17T23:12:43.439 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 13/31 2024-02-17T23:12:43.708 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 14/31 2024-02-17T23:12:44.276 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 15/31 2024-02-17T23:12:44.933 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 7/31 2024-02-17T23:12:45.159 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : containernetworking-plugins-1:1.4.0-1.module_el8+8 8/31 2024-02-17T23:12:45.286 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 16/31 2024-02-17T23:12:45.392 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : yajl-2.1.0-12.el8.x86_64 9/31 2024-02-17T23:12:45.539 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 17/31 2024-02-17T23:12:45.577 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : crun-1.14-1.module_el8+871+552be958.x86_64 10/31 2024-02-17T23:12:46.008 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 18/31 2024-02-17T23:12:46.236 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 19/31 2024-02-17T23:12:46.430 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 20/31 2024-02-17T23:12:46.676 INFO:teuthology.orchestra.run.smithi080.stdout: Upgrading : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 21/31 2024-02-17T23:12:46.736 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : containers-common-2:1-58.module_el8+804+f131391c.x 11/31 2024-02-17T23:12:46.866 INFO:teuthology.orchestra.run.smithi080.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 22/31 2024-02-17T23:12:46.908 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 12/31 2024-02-17T23:12:47.050 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : containers-common-2:1-49.module_el8.8.0+1254+78119 23/31 2024-02-17T23:12:47.103 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 13/31 2024-02-17T23:12:47.240 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 24/31 2024-02-17T23:12:47.377 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 14/31 2024-02-17T23:12:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/31 2024-02-17T23:12:47.381 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-17T23:12:47.607 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-17T23:12:47.843 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 27/31 2024-02-17T23:12:47.998 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 28/31 2024-02-17T23:12:48.023 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 15/31 2024-02-17T23:12:48.215 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 29/31 2024-02-17T23:12:48.419 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : containernetworking-plugins-1:1.1.1-3.module_el8.7 30/31 2024-02-17T23:12:48.639 INFO:teuthology.orchestra.run.smithi080.stdout: Cleanup : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-17T23:12:49.023 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 16/31 2024-02-17T23:12:49.271 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 17/31 2024-02-17T23:12:49.718 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 18/31 2024-02-17T23:12:49.923 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 19/31 2024-02-17T23:12:50.098 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 20/31 2024-02-17T23:12:50.335 INFO:teuthology.orchestra.run.smithi005.stdout: Upgrading : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 21/31 2024-02-17T23:12:50.504 INFO:teuthology.orchestra.run.smithi005.stdout: Installing : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 22/31 2024-02-17T23:12:50.694 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : containers-common-2:1-49.module_el8.8.0+1254+78119 23/31 2024-02-17T23:12:50.845 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 24/31 2024-02-17T23:12:51.053 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 25/31 2024-02-17T23:12:51.054 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-17T23:12:51.245 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 26/31 2024-02-17T23:12:51.486 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 27/31 2024-02-17T23:12:51.628 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 28/31 2024-02-17T23:12:51.792 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 29/31 2024-02-17T23:12:52.003 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : containernetworking-plugins-1:1.1.1-3.module_el8.7 30/31 2024-02-17T23:12:52.161 INFO:teuthology.orchestra.run.smithi005.stdout: Cleanup : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-17T23:13:08.230 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 31/31 2024-02-17T23:13:08.697 INFO:teuthology.orchestra.run.smithi080.stdout: Running scriptlet: conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-17T23:13:08.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/31 2024-02-17T23:13:08.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/31 2024-02-17T23:13:08.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/31 2024-02-17T23:13:08.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-17T23:13:08.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : crun-1.14-1.module_el8+871+552be958.x86_64 5/31 2024-02-17T23:13:08.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 6/31 2024-02-17T23:13:08.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/31 2024-02-17T23:13:08.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/31 2024-02-17T23:13:08.697 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 14/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 15/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : container-selinux-2:2.229.0-2.module_el8+847+7863d 16/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 17/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : containernetworking-plugins-1:1.4.0-1.module_el8+8 18/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 19/31 2024-02-17T23:13:08.698 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : containers-common-2:1-58.module_el8+804+f131391c.x 20/31 2024-02-17T23:13:08.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : containers-common-2:1-49.module_el8.8.0+1254+78119 21/31 2024-02-17T23:13:08.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : criu-3.18-4.module_el8+804+f131391c.x86_64 22/31 2024-02-17T23:13:08.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 23/31 2024-02-17T23:13:08.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 24/31 2024-02-17T23:13:08.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 25/31 2024-02-17T23:13:08.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 26/31 2024-02-17T23:13:08.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 27/31 2024-02-17T23:13:08.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 28/31 2024-02-17T23:13:08.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 29/31 2024-02-17T23:13:08.699 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 30/31 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 31/31 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout:Upgraded: 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: container-selinux-2:2.229.0-2.module_el8+847+7863d4e6.noarch 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: containernetworking-plugins-1:1.4.0-1.module_el8+804+f131391c.x86_64 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: containers-common-2:1-58.module_el8+804+f131391c.x86_64 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: criu-3.18-4.module_el8+804+f131391c.x86_64 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_64 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 2024-02-17T23:13:09.440 INFO:teuthology.orchestra.run.smithi080.stdout: slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout:Installed: 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: criu-libs-3.18-4.module_el8+804+f131391c.x86_64 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: crun-1.14-1.module_el8+871+552be958.x86_64 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:13:09.441 INFO:teuthology.orchestra.run.smithi080.stdout:Complete! 2024-02-17T23:13:09.746 DEBUG:teuthology.parallel:result is None 2024-02-17T23:13:12.130 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: container-selinux-2:2.229.0-2.module_el8+847+7863d 31/31 2024-02-17T23:13:12.620 INFO:teuthology.orchestra.run.smithi005.stdout: Running scriptlet: conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 31/31 2024-02-17T23:13:12.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/31 2024-02-17T23:13:12.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2/31 2024-02-17T23:13:12.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 3/31 2024-02-17T23:13:12.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : criu-libs-3.18-4.module_el8+804+f131391c.x86_64 4/31 2024-02-17T23:13:12.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : crun-1.14-1.module_el8+871+552be958.x86_64 5/31 2024-02-17T23:13:12.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 6/31 2024-02-17T23:13:12.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/31 2024-02-17T23:13:12.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/31 2024-02-17T23:13:12.621 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 11/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 14/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : conmon-3:2.1.5-1.module_el8.8.0+1254+78119b6e.x86_ 15/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : container-selinux-2:2.229.0-2.module_el8+847+7863d 16/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : container-selinux-2:2.195.1-1.module_el8.8.0+1254+ 17/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : containernetworking-plugins-1:1.4.0-1.module_el8+8 18/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : containernetworking-plugins-1:1.1.1-3.module_el8.7 19/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : containers-common-2:1-58.module_el8+804+f131391c.x 20/31 2024-02-17T23:13:12.622 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : containers-common-2:1-49.module_el8.8.0+1254+78119 21/31 2024-02-17T23:13:12.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : criu-3.18-4.module_el8+804+f131391c.x86_64 22/31 2024-02-17T23:13:12.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : criu-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 23/31 2024-02-17T23:13:12.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_ 24/31 2024-02-17T23:13:12.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : fuse-overlayfs-1.10-1.module_el8.8.0+1254+78119b6e 25/31 2024-02-17T23:13:12.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 26/31 2024-02-17T23:13:12.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : libslirp-4.4.0-1.module_el8.7.0+1216+b022c01d.x86_ 27/31 2024-02-17T23:13:12.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 28/31 2024-02-17T23:13:12.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : runc-1:1.1.4-1.module_el8.7.0+1216+b022c01d.x86_64 29/31 2024-02-17T23:13:12.623 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 30/31 2024-02-17T23:13:13.355 INFO:teuthology.orchestra.run.smithi005.stdout: Verifying : slirp4netns-1.2.0-2.module_el8.7.0+1216+b022c01d.x 31/31 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout:Upgraded: 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: conmon-3:2.1.10-1.module_el8+804+f131391c.x86_64 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: container-selinux-2:2.229.0-2.module_el8+847+7863d4e6.noarch 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: containernetworking-plugins-1:1.4.0-1.module_el8+804+f131391c.x86_64 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: containers-common-2:1-58.module_el8+804+f131391c.x86_64 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: criu-3.18-4.module_el8+804+f131391c.x86_64 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: fuse-overlayfs-1.13-1.module_el8+804+f131391c.x86_64 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: libslirp-4.4.0-1.module_el8+804+f131391c.x86_64 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: runc-1:1.1.12-1.module_el8+885+7da147f3.x86_64 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: slirp4netns-1.2.2-1.module_el8+804+f131391c.x86_64 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout:Installed: 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-02-17T23:13:13.356 INFO:teuthology.orchestra.run.smithi005.stdout: buildah-2:1.33.5-1.module_el8+885+7da147f3.x86_64 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: cockpit-podman-83-1.module_el8+847+7863d4e6.noarch 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: criu-libs-3.18-4.module_el8+804+f131391c.x86_64 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: crun-1.14-1.module_el8+871+552be958.x86_64 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: netavark-2:1.10.2-1.module_el8+885+7da147f3.x86_64 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: toolbox-0.0.99.5-1.module_el8+847+7863d4e6.x86_64 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: yajl-2.1.0-12.el8.x86_64 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:13:13.357 INFO:teuthology.orchestra.run.smithi005.stdout:Complete! 2024-02-17T23:13:13.694 DEBUG:teuthology.parallel:result is None 2024-02-17T23:13:13.694 INFO:teuthology.run_tasks:Running task cephadm... 2024-02-17T23:13:13.776 INFO:tasks.cephadm:Config: {'add_mons_via_daemon_add': True, 'allow_ptrace': False, 'avoid_pacific_features': True, 'cephadm_branch': 'v15.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v15.2.0', 'conf': {'global': {'mon election default strategy': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MON_DOWN\\)', '\\(PG_', 'mons down', 'pg inactive', 'out of quorum', '\\(OSD_', 'osds down', 'osd down'], 'sha1': '81bd20d634209c7cb82c18be12b4b5a05643ebf1'} 2024-02-17T23:13:13.776 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v15.2.0 2024-02-17T23:13:13.777 INFO:tasks.cephadm:Cluster fsid is 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:13.777 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-02-17T23:13:13.777 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.5', 'mon.c': '[v2:172.21.15.5:3301,v1:172.21.15.5:6790]', 'mon.b': '172.21.15.80'} 2024-02-17T23:13:13.777 INFO:tasks.cephadm:First mon is mon.a on smithi005 2024-02-17T23:13:13.777 INFO:tasks.cephadm:First mgr is y 2024-02-17T23:13:13.777 INFO:tasks.cephadm:Normalizing hostnames... 2024-02-17T23:13:13.778 DEBUG:teuthology.orchestra.run.smithi005:> sudo hostname $(hostname -s) 2024-02-17T23:13:13.807 DEBUG:teuthology.orchestra.run.smithi080:> sudo hostname $(hostname -s) 2024-02-17T23:13:13.842 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v15.2.0)... 2024-02-17T23:13:13.843 DEBUG:teuthology.orchestra.run.smithi005:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-17T23:13:14.089 INFO:teuthology.orchestra.run.smithi005.stdout:-rw-rw-r--. 1 ubuntu ubuntu 151122 Feb 17 23:13 /home/ubuntu/cephtest/cephadm 2024-02-17T23:13:14.090 DEBUG:teuthology.orchestra.run.smithi080:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v15.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-02-17T23:13:14.255 INFO:teuthology.orchestra.run.smithi080.stdout:-rw-rw-r--. 1 ubuntu ubuntu 151122 Feb 17 23:13 /home/ubuntu/cephtest/cephadm 2024-02-17T23:13:14.255 DEBUG:teuthology.orchestra.run.smithi005:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-17T23:13:14.275 DEBUG:teuthology.orchestra.run.smithi080:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-02-17T23:13:14.310 DEBUG:teuthology.orchestra.run.smithi005:> sudo mkdir -p /etc/ceph 2024-02-17T23:13:14.346 DEBUG:teuthology.orchestra.run.smithi080:> sudo mkdir -p /etc/ceph 2024-02-17T23:13:14.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 777 /etc/ceph 2024-02-17T23:13:14.414 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 777 /etc/ceph 2024-02-17T23:13:14.453 INFO:tasks.cephadm:Writing seed config... 2024-02-17T23:13:14.454 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2024-02-17T23:13:14.454 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-02-17T23:13:14.454 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-02-17T23:13:14.454 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-02-17T23:13:14.454 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-02-17T23:13:14.454 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-02-17T23:13:14.455 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-02-17T23:13:14.455 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-02-17T23:13:14.455 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-02-17T23:13:14.455 DEBUG:teuthology.orchestra.run.smithi005:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-02-17T23:13:14.474 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1ffcdf7e-cdea-11ee-95ba-87774f69a715 mon election default strategy = 1 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-02-17T23:13:14.474 DEBUG:teuthology.orchestra.run.smithi005:mon.a> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a.service 2024-02-17T23:13:14.516 DEBUG:teuthology.orchestra.run.smithi005:mgr.y> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y.service 2024-02-17T23:13:14.544 INFO:journalctl@ceph.mon.a.smithi005.stdout:-- Logs begin at Sat 2024-02-17 23:05:20 UTC. -- 2024-02-17T23:13:14.545 INFO:tasks.cephadm:Bootstrapping... 2024-02-17T23:13:14.545 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 -v bootstrap --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.5 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-02-17T23:13:14.572 INFO:journalctl@ceph.mgr.y.smithi005.stdout:-- Logs begin at Sat 2024-02-17 23:05:20 UTC. -- 2024-02-17T23:13:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Verifying podman|docker is present... 2024-02-17T23:13:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Verifying lvm2 is present... 2024-02-17T23:13:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Verifying time synchronization is in place... 2024-02-17T23:13:14.694 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2024-02-17T23:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-17T23:13:14.701 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2024-02-17T23:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-17T23:13:14.706 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2024-02-17T23:13:14.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stdout enabled 2024-02-17T23:13:14.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2024-02-17T23:13:14.717 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stdout active 2024-02-17T23:13:14.717 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2024-02-17T23:13:14.717 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Repeating the final host check... 2024-02-17T23:13:14.717 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:podman|docker (/bin/podman) is present 2024-02-17T23:13:14.717 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:systemctl is present 2024-02-17T23:13:14.717 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:lvcreate is present 2024-02-17T23:13:14.717 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chrony.service 2024-02-17T23:13:14.720 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stderr Failed to get unit file state for chrony.service: No such file or directory 2024-02-17T23:13:14.721 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-active chrony.service 2024-02-17T23:13:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-17T23:13:14.725 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-enabled chronyd.service 2024-02-17T23:13:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stdout enabled 2024-02-17T23:13:14.731 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-active chronyd.service 2024-02-17T23:13:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stdout active 2024-02-17T23:13:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Unit chronyd.service is enabled and running 2024-02-17T23:13:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Host looks OK 2024-02-17T23:13:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:root:Cluster fsid: 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Acquiring lock 139758224550040 on /run/cephadm/1ffcdf7e-cdea-11ee-95ba-87774f69a715.lock 2024-02-17T23:13:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Lock 139758224550040 acquired on /run/cephadm/1ffcdf7e-cdea-11ee-95ba-87774f69a715.lock 2024-02-17T23:13:14.736 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Verifying IP 172.21.15.5 port 3300 ... 2024-02-17T23:13:14.737 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Verifying IP 172.21.15.5 port 6789 ... 2024-02-17T23:13:14.737 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Base mon IP is 172.21.15.5, final addrv is [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-02-17T23:13:14.737 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /sbin/ip route ls 2024-02-17T23:13:14.738 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/sbin/ip:stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.5 metric 100 2024-02-17T23:13:14.738 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/sbin/ip:stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.5 metric 100 2024-02-17T23:13:14.738 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Mon IP 172.21.15.5 is in CIDR network 172.21.0.0/20 2024-02-17T23:13:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Pulling latest docker.io/ceph/ceph:v15.2.0 container... 2024-02-17T23:13:14.739 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman pull docker.io/ceph/ceph:v15.2.0 2024-02-17T23:13:16.512 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/bin/podman:stderr Trying to pull docker.io/ceph/ceph:v15.2.0... 2024-02-17T23:13:23.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/bin/podman:stderr Getting image source signatures 2024-02-17T23:13:23.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:120f0bd0d532e2094e4c344cda2d32931787ee8c2e5d6b9ddd4698dfe3ef6110 2024-02-17T23:13:23.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/bin/podman:stderr Copying blob sha256:8a29a15cefaeccf6545f7ecf11298f9672d2f0cdaf9e357a95133ac3ad3e1f07 2024-02-17T23:13:34.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/bin/podman:stderr Copying config sha256:204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1 2024-02-17T23:13:34.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/bin/podman:stderr Writing manifest to image destination 2024-02-17T23:13:34.598 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/bin/podman:stdout 204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1 2024-02-17T23:13:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Extracting ceph user uid/gid from container image... 2024-02-17T23:13:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '--entrypoint', 'stat', 'docker.io/ceph/ceph:v15.2.0', '-c', '%u %g', '/var/lib/ceph'] 2024-02-17T23:13:34.610 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 --entrypoint stat docker.io/ceph/ceph:v15.2.0 -c %u %g /var/lib/ceph 2024-02-17T23:13:35.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:stat:stdout 167 167 2024-02-17T23:13:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Creating initial keys... 2024-02-17T23:13:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-02-17T23:13:35.918 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-02-17T23:13:36.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQCgPdFliR2RFhAAxxHuj72zOf2SeA9y99S34A== 2024-02-17T23:13:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-02-17T23:13:37.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-02-17T23:13:37.692 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQChPdFlbItsIRAAb3KD1WoP2ePZXfkhLmeujg== 2024-02-17T23:13:38.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '--entrypoint', '/usr/bin/ceph-authtool', 'docker.io/ceph/ceph:v15.2.0', '--gen-print-key'] 2024-02-17T23:13:38.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 --entrypoint /usr/bin/ceph-authtool docker.io/ceph/ceph:v15.2.0 --gen-print-key 2024-02-17T23:13:38.965 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-authtool:stdout AQCiPdFlUi8eMhAAGm2mGKIBCqS9tEITXGoz+g== 2024-02-17T23:13:39.553 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Creating initial monmap... 2024-02-17T23:13:39.553 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/tmp/ceph-tmp14vddlus:/tmp/monmap:z', '--entrypoint', '/usr/bin/monmaptool', 'docker.io/ceph/ceph:v15.2.0', '--create', '--clobber', '--fsid', '1ffcdf7e-cdea-11ee-95ba-87774f69a715', '--addv', 'a', '[v2:172.21.15.5:3300,v1:172.21.15.5:6789]', '/tmp/monmap'] 2024-02-17T23:13:39.553 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /tmp/ceph-tmp14vddlus:/tmp/monmap:z --entrypoint /usr/bin/monmaptool docker.io/ceph/ceph:v15.2.0 --create --clobber --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 --addv a [v2:172.21.15.5:3300,v1:172.21.15.5:6789] /tmp/monmap 2024-02-17T23:13:40.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-02-17T23:13:40.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: set fsid to 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:40.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/monmaptool:stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-02-17T23:13:40.820 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Creating mon... 2024-02-17T23:13:40.821 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '-v', '/tmp/ceph-tmp8vats5wm:/tmp/keyring:z', '-v', '/tmp/ceph-tmp14vddlus:/tmp/monmap:z', '--entrypoint', '/usr/bin/ceph-mon', 'docker.io/ceph/ceph:v15.2.0', '--mkfs', '-i', 'a', '--fsid', '1ffcdf7e-cdea-11ee-95ba-87774f69a715', '-c', '/dev/null', '--monmap', '/tmp/monmap', '--keyring', '/tmp/keyring', '--setuser', 'ceph', '--setgroup', 'ceph', '--default-log-to-file=false', '--default-log-to-stderr=true', '--default-log-stderr-prefix="debug "', '--default-mon-cluster-log-to-file=false', '--default-mon-cluster-log-to-stderr=true'] 2024-02-17T23:13:40.821 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp8vats5wm:/tmp/keyring:z -v /tmp/ceph-tmp14vddlus:/tmp/monmap:z --entrypoint /usr/bin/ceph-mon docker.io/ceph/ceph:v15.2.0 --mkfs -i a --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2024-02-17T23:13:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.270+0000 7f9ffd5286c0 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-17T23:13:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 1 imported monmap: 2024-02-17T23:13:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr epoch 0 2024-02-17T23:13:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr last_changed 2024-02-17T23:13:40.033984+0000 2024-02-17T23:13:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr created 2024-02-17T23:13:40.033984+0000 2024-02-17T23:13:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr min_mon_release 0 (unknown) 2024-02-17T23:13:41.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 0: [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon.a 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 0 /usr/bin/ceph-mon: set fsid to 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 0 set rocksdb option compression = kNoCompression 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 0 set rocksdb option compression = kNoCompression 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: RocksDB version: 6.1.2 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Compile date Mar 23 2020 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: DB SUMMARY 2024-02-17T23:13:41.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.error_if_exists: 0 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.create_if_missing: 1 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.paranoid_checks: 1 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.env: 0x5576800ff1a0 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.info_log: 0x55768258daa0 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.statistics: (nil) 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.use_fsync: 0 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.max_log_file_size: 0 2024-02-17T23:13:41.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.271+0000 7f9ffd5286c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.allow_fallocate: 1 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.use_direct_reads: 0 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.create_missing_column_families: 0 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.db_log_dir: 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_subcompactions: 1 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_background_flushes: -1 2024-02-17T23:13:41.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.advise_random_on_open: 1 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.write_buffer_manager: 0x55768312c120 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.rate_limiter: (nil) 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-17T23:13:41.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.row_cache: None 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.wal_filter: None 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.preserve_deletes: 0 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.two_write_queues: 0 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.manual_wal_flush: 0 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.atomic_flush: 0 2024-02-17T23:13:41.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_background_jobs: 2 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_background_compactions: -1 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_total_wal_size: 0 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_open_files: -1 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.bytes_per_sync: 0 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Compression algorithms supported: 2024-02-17T23:13:41.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: kZSTD supported: 0 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: kXpressCompression supported: 0 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: kLZ4Compression supported: 1 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: kBZip2Compression supported: 0 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: kZlibCompression supported: 1 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: kSnappyCompression supported: 1 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: [db/db_impl_open.cc:228] Creating manifest 1 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-17T23:13:41.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.merge_operator: 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_filter: None 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_filter_factory: None 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5576824b2118) 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks: 1 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr cache_index_and_filter_blocks_with_high_priority: 1 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr pin_top_level_index_and_filter: 1 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_type: 0 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_index_type: 0 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr data_block_hash_table_util_ratio: 0.750000 2024-02-17T23:13:41.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr hash_index_allow_collision: 1 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr checksum: 1 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr no_block_cache: 0 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache: 0x5576824ec510 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_name: BinnedLRUCache 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_options: 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr capacity : 536870912 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr num_shard_bits : 4 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr strict_capacity_limit : 0 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr high_pri_pool_ratio: 0.000 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_cache_compressed: (nil) 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr persistent_cache: (nil) 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size: 4096 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_size_deviation: 10 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_restart_interval: 16 2024-02-17T23:13:41.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr index_block_restart_interval: 1 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr metadata_block_size: 4096 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr partition_filters: 0 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr use_delta_encoding: 1 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr filter_policy: rocksdb.BuiltinBloomFilter 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr whole_key_filtering: 1 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr verify_compression: 0 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr read_amp_bytes_per_bit: 0 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr format_version: 2 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr enable_index_compression: 1 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr block_align: 0 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compression: NoCompression 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-17T23:13:41.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.num_levels: 7 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compression_opts.level: 32767 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-17T23:13:41.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:13:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compression_opts.enabled: false 2024-02-17T23:13:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-17T23:13:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-17T23:13:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-17T23:13:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-17T23:13:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-17T23:13:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-17T23:13:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-17T23:13:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-17T23:13:41.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.arena_block_size: 4194304 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.272+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-17T23:13:41.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.table_properties_collectors: 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.inplace_update_support: 0 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-17T23:13:41.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.bloom_locality: 0 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.max_successive_merges: 0 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.force_consistency_checks: 0 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: Options.ttl: 0 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.273+0000 7f9ffd5286c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.274+0000 7f9ffd5286c0 4 rocksdb: DB pointer 0x557682587200 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.274+0000 7f9fe66e9700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.274+0000 7f9fe66e9700 4 rocksdb: [db/db_impl.cc:778] 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** DB Stats ** 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:13:41.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:13:41.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:13:41.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** Compaction Stats [default] ** 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Flush(GB): cumulative 0.000, interval 0.000 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:13:41.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:13:41.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr 2024-02-17T23:13:41.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.275+0000 7f9ffd5286c0 4 rocksdb: [db/db_impl.cc:390] Shutdown: canceling all background work 2024-02-17T23:13:41.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.275+0000 7f9ffd5286c0 4 rocksdb: [db/db_impl.cc:563] Shutdown complete 2024-02-17T23:13:41.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph-mon:stderr "debug "2024-02-17T23:13:41.276+0000 7f9ffd5286c0 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2024-02-17T23:13:41.997 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:42.002 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl disable ceph.target 2024-02-17T23:13:42.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl enable ceph.target 2024-02-17T23:13:42.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-02-17T23:13:42.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl start ceph.target 2024-02-17T23:13:42.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715.target 2024-02-17T23:13:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715.target. 2024-02-17T23:13:42.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715.target → /etc/systemd/system/ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715.target. 2024-02-17T23:13:42.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl start ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715.target 2024-02-17T23:13:42.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2024-02-17T23:13:42.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a 2024-02-17T23:13:42.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a 2024-02-17T23:13:42.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a.service: Unit ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a.service not loaded. 2024-02-17T23:13:42.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a 2024-02-17T23:13:42.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715.target.wants/ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a.service → /etc/systemd/system/ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@.service. 2024-02-17T23:13:42.516 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl start ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a 2024-02-17T23:13:42.548 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:42 smithi005 systemd[1]: Starting Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:13:42.570 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2024-02-17T23:13:42.578 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stdout disabled 2024-02-17T23:13:42.578 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2024-02-17T23:13:42.586 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-17T23:13:42.586 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:firewalld.service is not enabled 2024-02-17T23:13:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Waiting for mon to start... 2024-02-17T23:13:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Waiting for mon... 2024-02-17T23:13:42.587 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status 2024-02-17T23:13:42.814 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:42 smithi005 podman[34786]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon.a" found: no such container 2024-02-17T23:13:42.814 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:42 smithi005 systemd[1]: Started Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:13:43.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:43 smithi005 bash[34803]: cluster 2024-02-17T23:13:43.219818+0000 mon.a (mon.0) 0 : [INF] mkfs 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:43.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:43 smithi005 bash[34803]: cluster 2024-02-17T23:13:43.205816+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-17T23:13:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout cluster: 2024-02-17T23:13:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout id: 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout health: HEALTH_OK 2024-02-17T23:13:43.575 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout services: 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon: 1 daemons, quorum a (age 0.353177s) 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr: no daemons active 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd: 0 osds: 0 up, 0 in 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout data: 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pools: 0 pools, 0 pgs 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout objects: 0 objects, 0 B 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout usage: 0 B used, 0 B / 0 B avail 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout pgs: 2024-02-17T23:13:43.576 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-17T23:13:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Assimilating anything we can from ceph.conf... 2024-02-17T23:13:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'assimilate-conf', '-i', '/var/lib/ceph/mon/ceph-a/config'] 2024-02-17T23:13:44.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z -v /var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2024-02-17T23:13:44.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:44 smithi005 bash[34803]: cluster 2024-02-17T23:13:43.219404+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-17T23:13:44.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:44 smithi005 bash[34803]: cluster 2024-02-17T23:13:43.219518+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} 2024-02-17T23:13:44.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:44 smithi005 bash[34803]: cluster 2024-02-17T23:13:43.220820+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-17T23:13:44.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:44 smithi005 bash[34803]: cluster 2024-02-17T23:13:43.222362+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-17T23:13:44.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:44 smithi005 bash[34803]: cluster 2024-02-17T23:13:43.222677+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-02-17T23:13:44.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:44 smithi005 bash[34803]: audit 2024-02-17T23:13:43.572553+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.5:0/560369890' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-02-17T23:13:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-17T23:13:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [global] 2024-02-17T23:13:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout fsid = 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout log_to_journald = false 2024-02-17T23:13:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_election_default_strategy = 1 2024-02-17T23:13:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_host = [v2:172.21.15.5:3300,v1:172.21.15.5:6789] 2024-02-17T23:13:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_pg_remap = true 2024-02-17T23:13:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_osd_allow_primary_affinity = true 2024-02-17T23:13:44.749 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_no_sortbitwise = false 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_crush_chooseleaf_type = 0 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mgr] 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mgr/telemetry/nag = false 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [mon] 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_insecure_global_id_reclaim = false 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout [osd] 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_map_max_advance = 10 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_memory_target_autotune = true 2024-02-17T23:13:44.750 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout osd_sloppy_crc = true 2024-02-17T23:13:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Generating new minimal ceph.conf... 2024-02-17T23:13:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '-v', '/var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'generate-minimal-conf', '-o', '/var/lib/ceph/mon/ceph-a/config'] 2024-02-17T23:13:45.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z -v /var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/mon.a:/var/lib/ceph/mon/ceph-a:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2024-02-17T23:13:45.369 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:45 smithi005 bash[34803]: audit 2024-02-17T23:13:44.741873+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.5:0/3651280899' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-02-17T23:13:45.369 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:45 smithi005 bash[34803]: audit 2024-02-17T23:13:44.744303+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.5:0/3651280899' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-02-17T23:13:46.319 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:46 smithi005 bash[34803]: audit 2024-02-17T23:13:45.975385+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.5:0/4157948211' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:13:46.656 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Restarting the monitor... 2024-02-17T23:13:46.657 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl restart ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a 2024-02-17T23:13:46.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:46 smithi005 systemd[1]: Stopping Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:13:46.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:46 smithi005 bash[34803]: debug 2024-02-17T23:13:46.775+0000 7f5acaa90700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:13:46.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:46 smithi005 bash[34803]: debug 2024-02-17T23:13:46.775+0000 7f5acaa90700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-02-17T23:13:47.978 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:47 smithi005 podman[35132]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon.a 2024-02-17T23:13:47.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:47 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a.service: Succeeded. 2024-02-17T23:13:47.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:47 smithi005 systemd[1]: Stopped Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:13:47.979 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:47 smithi005 systemd[1]: Starting Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:13:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Setting mon public_network... 2024-02-17T23:13:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'set', 'mon', 'public_network', '172.21.0.0/20'] 2024-02-17T23:13:47.997 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config set mon public_network 172.21.0.0/20 2024-02-17T23:13:48.271 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:47 smithi005 podman[35174]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon.a" found: no such container 2024-02-17T23:13:48.272 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:47 smithi005 systemd[1]: Started Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:13:49.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.603+0000 7f161131a6c0 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-17T23:13:49.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.603+0000 7f161131a6c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2024-02-17T23:13:49.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.603+0000 7f161131a6c0 0 pidfile_write: ignore empty --pid-file 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.607+0000 7f161131a6c0 0 load: jerasure load: lrc load: isa 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.607+0000 7f161131a6c0 0 set rocksdb option compression = kNoCompression 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.607+0000 7f161131a6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.607+0000 7f161131a6c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 0 set rocksdb option compression = kNoCompression 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 1 rocksdb: do_open column families: [default] 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: RocksDB version: 6.1.2 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Compile date Mar 23 2020 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: DB SUMMARY 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: CURRENT file: CURRENT 2024-02-17T23:13:49.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: IDENTITY file: IDENTITY 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 109 Bytes 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 69373 ; 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.error_if_exists: 0 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.create_if_missing: 0 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.paranoid_checks: 1 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.env: 0x55abf0e7b1a0 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.info_log: 0x55abf33b49c0 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.statistics: (nil) 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.use_fsync: 0 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_log_file_size: 0 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-17T23:13:49.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.allow_fallocate: 1 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.use_direct_reads: 0 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.create_missing_column_families: 0 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.db_log_dir: 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_subcompactions: 1 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_background_flushes: -1 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-17T23:13:49.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.advise_random_on_open: 1 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.write_buffer_manager: 0x55abf3f4cae0 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.rate_limiter: (nil) 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-17T23:13:49.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.row_cache: None 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.wal_filter: None 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.preserve_deletes: 0 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.two_write_queues: 0 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.manual_wal_flush: 0 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.atomic_flush: 0 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_background_jobs: 2 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_background_compactions: -1 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-17T23:13:49.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_total_wal_size: 0 2024-02-17T23:13:49.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-17T23:13:49.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-17T23:13:49.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-17T23:13:49.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-17T23:13:49.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_open_files: -1 2024-02-17T23:13:49.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.bytes_per_sync: 0 2024-02-17T23:13:49.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-17T23:13:49.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-17T23:13:49.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Compression algorithms supported: 2024-02-17T23:13:49.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: kZSTD supported: 0 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: kXpressCompression supported: 0 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: kLZ4Compression supported: 1 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: kBZip2Compression supported: 0 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: kZlibCompression supported: 1 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: kSnappyCompression supported: 1 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.merge_operator: 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_filter: None 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_filter_factory: None 2024-02-17T23:13:49.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55abf32d0130) 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: cache_index_and_filter_blocks: 1 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: cache_index_and_filter_blocks_with_high_priority: 1 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: pin_top_level_index_and_filter: 1 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: index_type: 0 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: data_block_index_type: 0 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: data_block_hash_table_util_ratio: 0.750000 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: hash_index_allow_collision: 1 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: checksum: 1 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: no_block_cache: 0 2024-02-17T23:13:49.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: block_cache: 0x55abf330a610 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: block_cache_name: BinnedLRUCache 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: block_cache_options: 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: capacity : 536870912 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: num_shard_bits : 4 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: strict_capacity_limit : 0 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: high_pri_pool_ratio: 0.000 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: block_cache_compressed: (nil) 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: persistent_cache: (nil) 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: block_size: 4096 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: block_size_deviation: 10 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: block_restart_interval: 16 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: index_block_restart_interval: 1 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: metadata_block_size: 4096 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: partition_filters: 0 2024-02-17T23:13:49.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: use_delta_encoding: 1 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: whole_key_filtering: 1 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: verify_compression: 0 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: read_amp_bytes_per_bit: 0 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: format_version: 2 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: enable_index_compression: 1 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: block_align: 0 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compression: NoCompression 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.num_levels: 7 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-17T23:13:49.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compression_opts.level: 32767 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compression_opts.enabled: false 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-17T23:13:49.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.arena_block_size: 4194304 2024-02-17T23:13:49.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.table_properties_collectors: 2024-02-17T23:13:49.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.inplace_update_support: 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.bloom_locality: 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.max_successive_merges: 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.force_consistency_checks: 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.608+0000 7f161131a6c0 4 rocksdb: Options.ttl: 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.609+0000 7f161131a6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.609+0000 7f161131a6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 4 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.609+0000 7f161131a6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708211628609437, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-02-17T23:13:49.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.609+0000 7f161131a6c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #6 mode 2 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.610+0000 7f161131a6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708211628610266, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 66414, "table_properties": {"data_size": 64709, "index_size": 310, "filter_size": 581, "raw_key_size": 8761, "raw_average_key_size": 46, "raw_value_size": 59668, "raw_average_value_size": 319, "num_data_blocks": 10, "num_entries": 187, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.610+0000 7f161131a6c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 8 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.610+0000 7f161131a6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708211628610635, "job": 1, "event": "recovery_finished"} 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.611+0000 7f161131a6c0 4 rocksdb: DB pointer 0x55abf33a5200 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.611+0000 7f15f8467700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.611+0000 7f15f8467700 4 rocksdb: [db/db_impl.cc:778] 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ** DB Stats ** 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ** Compaction Stats [default] ** 2024-02-17T23:13:49.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: L0 2/0 66.48 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.9 0.00 0.00 1 0.001 0 0 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Sum 2/0 66.48 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.9 0.00 0.00 1 0.001 0 0 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.9 0.00 0.00 1 0.001 0 0 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ** Compaction Stats [default] ** 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 117.9 0.00 0.00 1 0.001 0 0 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:13:49.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Cumulative compaction: 0.00 GB write, 22.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Interval compaction: 0.00 GB write, 22.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ** Compaction Stats [default] ** 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: L0 2/0 66.48 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.9 0.00 0.00 1 0.001 0 0 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Sum 2/0 66.48 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 117.9 0.00 0.00 1 0.001 0 0 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ** Compaction Stats [default] ** 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:13:49.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 117.9 0.00 0.00 1 0.001 0 0 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Cumulative compaction: 0.00 GB write, 22.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.612+0000 7f161131a6c0 0 starting mon.a rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.613+0000 7f161131a6c0 1 mon.a@-1(???) e1 preinit fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.613+0000 7f161131a6c0 0 mon.a@-1(???).mds e1 new map 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.613+0000 7f161131a6c0 0 mon.a@-1(???).mds e1 print_map 2024-02-17T23:13:49.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: e1 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: legacy client fscid: -1 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: No filesystems configured 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.613+0000 7f161131a6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.613+0000 7f161131a6c0 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.613+0000 7f161131a6c0 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: audit 2024-02-17T23:13:45.975385+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.5:0/4157948211' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.613+0000 7f161131a6c0 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta expand map: {default=false} 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta from 'false' to 'false' 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta expanded map: {default=false} 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta expand map: {default=info} 2024-02-17T23:13:49.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta from 'info' to 'info' 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta expanded map: {default=info} 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta expand map: {default=daemon} 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta from 'daemon' to 'daemon' 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta expanded map: {default=daemon} 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta expand map: {default=debug} 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta from 'debug' to 'debug' 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: debug 2024-02-17T23:13:48.614+0000 7f161131a6c0 20 expand_channel_meta expanded map: {default=debug} 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: cluster 2024-02-17T23:13:48.629793+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: cluster 2024-02-17T23:13:48.629836+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0]} 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: cluster 2024-02-17T23:13:48.629866+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: cluster 2024-02-17T23:13:48.629889+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-02-17T23:13:49.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:48 smithi005 bash[35193]: cluster 2024-02-17T23:13:48.630181+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-02-17T23:13:49.460 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Creating mgr... 2024-02-17T23:13:49.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl daemon-reload 2024-02-17T23:13:49.566 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y 2024-02-17T23:13:49.590 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl reset-failed ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y 2024-02-17T23:13:49.595 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stderr Failed to reset failed state of unit ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y.service: Unit ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y.service not loaded. 2024-02-17T23:13:49.596 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl enable ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y 2024-02-17T23:13:49.601 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stderr Created symlink /etc/systemd/system/ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715.target.wants/ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y.service → /etc/systemd/system/ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@.service. 2024-02-17T23:13:49.689 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl start ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y 2024-02-17T23:13:49.725 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-enabled firewalld.service 2024-02-17T23:13:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stdout disabled 2024-02-17T23:13:49.733 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: systemctl is-active firewalld.service 2024-02-17T23:13:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:systemctl:stdout inactive 2024-02-17T23:13:49.741 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:firewalld.service is not enabled 2024-02-17T23:13:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-02-17T23:13:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Wrote config to /etc/ceph/ceph.conf 2024-02-17T23:13:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Waiting for mgr to start... 2024-02-17T23:13:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Waiting for mgr... 2024-02-17T23:13:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-02-17T23:13:49.742 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-02-17T23:13:49.875 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:49 smithi005 bash[35193]: audit 2024-02-17T23:13:48.860001+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.5:0/3846770239' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]: dispatch 2024-02-17T23:13:49.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:49 smithi005 bash[35193]: audit 2024-02-17T23:13:48.861964+0000 mon.a (mon.0) 7 : audit [INF] from='client.? 172.21.15.5:0/3846770239' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "public_network", "value": "172.21.0.0/20"}]': finished 2024-02-17T23:13:49.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:13:49 smithi005 podman[35410]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.y" found: no such container 2024-02-17T23:13:49.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:13:49 smithi005 systemd[1]: Started Ceph mgr.y for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:13:50.639 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-17T23:13:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:13:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "1ffcdf7e-cdea-11ee-95ba-87774f69a715", 2024-02-17T23:13:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-02-17T23:13:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-02-17T23:13:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-02-17T23:13:50.640 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-02-17T23:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-02-17T23:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-02-17T23:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-02-17T23:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-02-17T23:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-02-17T23:13:50.641 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 2, 2024-02-17T23:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-02-17T23:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-02-17T23:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-02-17T23:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-02-17T23:13:50.642 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-02-17T23:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-02-17T23:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-02-17T23:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-02-17T23:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-02-17T23:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-02-17T23:13:50.643 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-02-17T23:13:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-02-17T23:13:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-02-17T23:13:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-02-17T23:13:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-02-17T23:13:50.644 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-02-17T23:13:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-02-17T23:13:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-02-17T23:13:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-02-17T23:13:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-02-17T23:13:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:50.645 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-02-17T23:13:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-02-17T23:13:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-02-17T23:13:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2024-02-17T23:13:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-02-17T23:13:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-17T23:13:50.646 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-17T23:13:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-17T23:13:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:13:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-17T23:13:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-02-17T23:13:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-02-17T23:13:43.220176+0000", 2024-02-17T23:13:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-17T23:13:50.647 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-02-17T23:13:50.648 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:13:51.034 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:50 smithi005 bash[35193]: audit 2024-02-17T23:13:50.632434+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.5:0/2773030689' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-17T23:13:51.314 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:mgr not available, waiting (1/10)... 2024-02-17T23:13:52.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-02-17T23:13:52.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-02-17T23:13:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-17T23:13:52.938 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "1ffcdf7e-cdea-11ee-95ba-87774f69a715", 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 4, 2024-02-17T23:13:52.939 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-02-17T23:13:52.940 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": false, 2024-02-17T23:13:52.941 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-02-17T23:13:43.220176+0000", 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-02-17T23:13:52.942 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:13:53.283 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:52 smithi005 bash[35193]: audit 2024-02-17T23:13:52.932115+0000 mon.a (mon.0) 9 : audit [DBG] from='client.? 172.21.15.5:0/3366801772' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-17T23:13:53.611 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:mgr not available, waiting (2/10)... 2024-02-17T23:13:54.612 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'status', '-f', 'json-pretty'] 2024-02-17T23:13:54.612 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 status -f json-pretty 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: cluster 2024-02-17T23:13:54.156984+0000 mon.a (mon.0) 10 : cluster [INF] Activating manager daemon y 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: cluster 2024-02-17T23:13:54.159400+0000 mon.a (mon.0) 11 : cluster [DBG] mgrmap e2: y(active, starting, since 0.00252059s) 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: audit 2024-02-17T23:13:54.159958+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: audit 2024-02-17T23:13:54.160068+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: audit 2024-02-17T23:13:54.160188+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: audit 2024-02-17T23:13:54.160630+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: audit 2024-02-17T23:13:54.160817+0000 mon.a (mon.0) 16 : audit [DBG] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: cluster 2024-02-17T23:13:54.174296+0000 mon.a (mon.0) 17 : cluster [INF] Manager daemon y is now available 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: audit 2024-02-17T23:13:54.184308+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: audit 2024-02-17T23:13:54.614906+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2024-02-17T23:13:54.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: cluster 2024-02-17T23:13:54.614952+0000 mon.a (mon.0) 20 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-02-17T23:13:54.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:54 smithi005 bash[35193]: audit 2024-02-17T23:13:54.615678+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:13:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 2024-02-17T23:13:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:13:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsid": "1ffcdf7e-cdea-11ee-95ba-87774f69a715", 2024-02-17T23:13:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "health": { 2024-02-17T23:13:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status": "HEALTH_OK", 2024-02-17T23:13:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "checks": {}, 2024-02-17T23:13:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mutes": [] 2024-02-17T23:13:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "election_epoch": 5, 2024-02-17T23:13:55.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum": [ 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 0 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_names": [ 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "a" 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "quorum_age": 6, 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "monmap": { 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_mon_release_name": "octopus", 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_mons": 1 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osdmap": { 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 2, 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_osds": 0, 2024-02-17T23:13:55.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_up_osds": 0, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_up_since": 0, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_in_osds": 0, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_in_since": 0, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_remapped_pgs": 0 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgmap": { 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pgs_by_state": [], 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pgs": 0, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_pools": 0, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_objects": 0, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "data_bytes": 0, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_used": 0, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_avail": 0, 2024-02-17T23:13:55.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "bytes_total": 0 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "fsmap": { 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "by_rank": [], 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "up:standby": 0 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap": { 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_standbys": 0, 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-17T23:13:55.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "servicemap": { 2024-02-17T23:13:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 1, 2024-02-17T23:13:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modified": "2024-02-17T23:13:43.220176+0000", 2024-02-17T23:13:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {} 2024-02-17T23:13:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:13:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress_events": {} 2024-02-17T23:13:55.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:13:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Enabling cephadm module... 2024-02-17T23:13:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'cephadm'] 2024-02-17T23:13:55.817 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable cephadm 2024-02-17T23:13:56.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:56 smithi005 bash[35193]: audit 2024-02-17T23:13:54.621680+0000 mon.a (mon.0) 22 : audit [INF] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"6b48acb5-cf75-427e-9613-c24d2d0cba98"}]: dispatch 2024-02-17T23:13:56.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:56 smithi005 bash[35193]: audit 2024-02-17T23:13:54.623950+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/report_id","val":"6b48acb5-cf75-427e-9613-c24d2d0cba98"}]': finished 2024-02-17T23:13:56.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:56 smithi005 bash[35193]: audit 2024-02-17T23:13:54.624364+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"07414dab-be1b-4285-b9d1-a167d607fbc9"}]: dispatch 2024-02-17T23:13:56.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:56 smithi005 bash[35193]: audit 2024-02-17T23:13:54.626393+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/telemetry/salt","val":"07414dab-be1b-4285-b9d1-a167d607fbc9"}]': finished 2024-02-17T23:13:56.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:56 smithi005 bash[35193]: cluster 2024-02-17T23:13:55.161773+0000 mon.a (mon.0) 26 : cluster [DBG] mgrmap e3: y(active, since 1.00489s) 2024-02-17T23:13:56.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:56 smithi005 bash[35193]: audit 2024-02-17T23:13:55.203958+0000 mon.a (mon.0) 27 : audit [DBG] from='client.? 172.21.15.5:0/312360242' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-02-17T23:13:56.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:56 smithi005 bash[35193]: audit 2024-02-17T23:13:55.615168+0000 mon.a (mon.0) 28 : audit [INF] from='mgr.14100 172.21.15.5:0/715467222' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-17T23:13:56.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:56 smithi005 bash[35193]: cluster 2024-02-17T23:13:55.615206+0000 mon.a (mon.0) 29 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-02-17T23:13:56.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:56 smithi005 bash[35193]: audit 2024-02-17T23:13:55.617018+0000 mon.a (mon.0) 30 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-17T23:13:57.875 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:13:57 smithi005 bash[35426]: ignoring --setuser ceph since I am not root 2024-02-17T23:13:57.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:13:57 smithi005 bash[35426]: ignoring --setgroup ceph since I am not root 2024-02-17T23:13:57.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:57 smithi005 bash[35193]: audit 2024-02-17T23:13:56.511425+0000 mon.a (mon.0) 31 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-17T23:13:57.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:57 smithi005 bash[35193]: cluster 2024-02-17T23:13:56.616278+0000 mon.a (mon.0) 32 : cluster [DBG] mgrmap e4: y(active, since 2s) 2024-02-17T23:13:57.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:57 smithi005 bash[35193]: audit 2024-02-17T23:13:56.712491+0000 mon.a (mon.0) 33 : audit [INF] from='client.? 172.21.15.5:0/3706360368' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-02-17T23:13:58.617 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:58 smithi005 bash[35193]: audit 2024-02-17T23:13:57.617457+0000 mon.a (mon.0) 34 : audit [INF] from='client.? 172.21.15.5:0/3706360368' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-02-17T23:13:58.617 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:13:58 smithi005 bash[35193]: cluster 2024-02-17T23:13:57.617506+0000 mon.a (mon.0) 35 : cluster [DBG] mgrmap e5: y(active, since 3s) 2024-02-17T23:14:00.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2024-02-17T23:14:00.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: cluster 2024-02-17T23:14:01.424056+0000 mon.a (mon.0) 36 : cluster [INF] Active manager daemon y restarted 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: cluster 2024-02-17T23:14:01.424607+0000 mon.a (mon.0) 37 : cluster [INF] Activating manager daemon y 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: cluster 2024-02-17T23:14:01.426194+0000 mon.a (mon.0) 38 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: cluster 2024-02-17T23:14:01.476760+0000 mon.a (mon.0) 39 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0522532s) 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: audit 2024-02-17T23:14:01.478071+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: audit 2024-02-17T23:14:01.478726+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: audit 2024-02-17T23:14:01.478859+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: audit 2024-02-17T23:14:01.478993+0000 mon.a (mon.0) 43 : audit [DBG] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: audit 2024-02-17T23:14:01.479284+0000 mon.a (mon.0) 44 : audit [DBG] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: audit 2024-02-17T23:14:01.479798+0000 mon.a (mon.0) 45 : audit [DBG] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:14:02.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: audit 2024-02-17T23:14:01.480018+0000 mon.a (mon.0) 46 : audit [DBG] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:14:02.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: cluster 2024-02-17T23:14:01.493204+0000 mon.a (mon.0) 47 : cluster [INF] Manager daemon y is now available 2024-02-17T23:14:02.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: audit 2024-02-17T23:14:01.512730+0000 mon.a (mon.0) 48 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-17T23:14:02.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:02 smithi005 bash[35193]: audit 2024-02-17T23:14:02.398466+0000 mon.a (mon.0) 49 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-17T23:14:03.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:03 smithi005 bash[35193]: cluster 2024-02-17T23:14:02.478872+0000 mon.a (mon.0) 50 : cluster [DBG] mgrmap e7: y(active, since 1.05435s) 2024-02-17T23:14:03.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:03 smithi005 bash[35193]: audit 2024-02-17T23:14:03.319478+0000 mon.a (mon.0) 51 : audit [DBG] from='client.? 172.21.15.5:0/1932044869' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2024-02-17T23:14:03.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:03.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 7, 2024-02-17T23:14:03.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2024-02-17T23:14:03.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2024-02-17T23:14:03.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2024-02-17T23:14:03.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-17T23:14:03.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:03.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-17T23:14:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.5:6800", 2024-02-17T23:14:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1225164636 2024-02-17T23:14:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2024-02-17T23:14:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.5:6801", 2024-02-17T23:14:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1225164636 2024-02-17T23:14:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-17T23:14:03.712 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.5:6801/1225164636", 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2024-02-17T23:14:01.424498+0000", 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:03.713 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2024-02-17T23:14:04.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-17T23:14:04.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2024-02-17T23:14:04.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2024-02-17T23:14:04.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2024-02-17T23:14:04.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2024-02-17T23:14:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2024-02-17T23:14:04.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2024-02-17T23:14:04.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-17T23:14:04.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-17T23:14:04.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2024-02-17T23:14:04.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2024-02-17T23:14:04.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2024-02-17T23:14:04.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-17T23:14:04.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2024-02-17T23:14:04.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2024-02-17T23:14:04.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2024-02-17T23:14:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2024-02-17T23:14:04.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-17T23:14:04.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2024-02-17T23:14:04.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2024-02-17T23:14:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-17T23:14:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-17T23:14:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-17T23:14:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2024-02-17T23:14:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2024-02-17T23:14:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2024-02-17T23:14:04.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2024-02-17T23:14:04.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2024-02-17T23:14:04.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2024-02-17T23:14:04.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2024-02-17T23:14:04.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2024-02-17T23:14:04.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2024-02-17T23:14:04.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-17T23:14:04.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2024-02-17T23:14:04.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-17T23:14:04.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2024-02-17T23:14:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2024-02-17T23:14:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2024-02-17T23:14:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2024-02-17T23:14:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2024-02-17T23:14:04.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.309 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.310 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.311 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.312 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.313 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2024-02-17T23:14:04.314 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.315 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.316 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-17T23:14:04.317 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2024-02-17T23:14:04.318 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.319 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.320 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.321 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.322 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.323 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.324 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.325 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.326 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.327 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.328 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.329 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.330 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.331 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.332 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2024-02-17T23:14:04.333 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.334 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.335 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.336 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.337 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.338 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.339 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.340 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.341 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.342 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.343 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.344 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.345 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.346 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2024-02-17T23:14:04.347 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2024-02-17T23:14:04.348 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.349 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.350 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.351 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.352 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.353 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.354 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.355 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.356 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2024-02-17T23:14:04.358 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.359 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.360 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.361 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.362 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.363 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.364 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.365 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.366 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.367 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.368 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.369 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.370 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-17T23:14:04.371 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.372 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.373 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.374 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.375 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.376 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.377 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.378 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-17T23:14:04.379 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.380 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.381 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.382 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.383 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.384 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.385 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2024-02-17T23:14:04.386 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2024-02-17T23:14:04.387 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2024-02-17T23:14:04.388 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.389 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.390 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.391 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.392 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.393 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.394 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.395 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.396 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.397 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.398 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2024-02-17T23:14:04.399 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.400 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.401 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.402 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.403 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.404 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.405 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.406 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-17T23:14:04.407 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.408 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.409 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.410 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.411 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.412 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.413 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.414 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.415 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2024-02-17T23:14:04.416 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.417 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.418 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.419 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.420 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.421 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.422 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.423 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2024-02-17T23:14:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2024-02-17T23:14:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.424 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2024-02-17T23:14:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.425 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.426 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.427 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.428 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.429 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.430 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.431 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.432 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.433 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.434 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.437 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.438 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.439 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.440 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.441 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2024-02-17T23:14:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2024-02-17T23:14:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2024-02-17T23:14:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.442 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-17T23:14:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.443 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-17T23:14:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-17T23:14:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2024-02-17T23:14:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.444 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.445 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.445 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.445 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.445 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.445 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.445 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.445 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.445 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.445 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.445 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.446 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.447 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.448 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.449 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.450 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.451 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.452 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.452 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.452 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.452 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.452 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.452 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2024-02-17T23:14:04.452 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.452 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.452 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2024-02-17T23:14:04.453 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.454 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.454 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.454 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.454 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2024-02-17T23:14:04.454 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2024-02-17T23:14:04.454 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.454 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.454 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.454 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2024-02-17T23:14:04.455 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.456 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.456 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.456 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:04.456 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.456 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.456 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.456 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.456 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.456 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2024-02-17T23:14:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2024-02-17T23:14:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.457 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2024-02-17T23:14:04.458 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2024-02-17T23:14:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.459 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2024-02-17T23:14:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2024-02-17T23:14:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:04.460 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.461 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.462 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-17T23:14:04.463 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.464 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.465 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.466 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.467 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.468 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.469 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.470 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.471 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:04.472 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.473 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.474 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.476 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.477 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.478 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.479 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.480 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.481 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.482 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.483 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.484 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.485 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.486 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2024-02-17T23:14:04.487 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.488 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.489 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.490 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.491 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.492 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.493 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:04.494 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:04.495 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2024-02-17T23:14:04.496 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.497 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.498 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:04.499 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-17T23:14:04.500 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-17T23:14:04.501 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-17T23:14:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2024-02-17T23:14:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-17T23:14:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2024-02-17T23:14:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [] 2024-02-17T23:14:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.502 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:04.875 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:04 smithi005 bash[35193]: cluster 2024-02-17T23:14:03.480675+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2024-02-17T23:14:08.270 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Waiting for the mgr to restart... 2024-02-17T23:14:08.271 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Waiting for Mgr epoch 7... 2024-02-17T23:14:08.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2024-02-17T23:14:08.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2024-02-17T23:14:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 8, 2024-02-17T23:14:10.531 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2024-02-17T23:14:10.532 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Setting orchestrator backend to cephadm... 2024-02-17T23:14:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'set', 'backend', 'cephadm'] 2024-02-17T23:14:11.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch set backend cephadm 2024-02-17T23:14:12.280 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:12 smithi005 bash[35193]: audit 2024-02-17T23:14:11.974005+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]: dispatch 2024-02-17T23:14:12.280 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:12 smithi005 bash[35193]: audit 2024-02-17T23:14:11.976578+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd='[{"prefix":"config set","value":"cephadm","who":"mgr","name":"mgr/orchestrator/orchestrator"}]': finished 2024-02-17T23:14:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Generating ssh key... 2024-02-17T23:14:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'generate-key'] 2024-02-17T23:14:12.626 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm generate-key 2024-02-17T23:14:13.375 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35193]: audit 2024-02-17T23:14:11.972842+0000 mgr.y (mgr.14117) 1 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:14:13.787 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: Generating public/private rsa key pair. 2024-02-17T23:14:13.787 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: Your identification has been saved in /tmp/tmpxbp5ijoo/key. 2024-02-17T23:14:13.787 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: Your public key has been saved in /tmp/tmpxbp5ijoo/key.pub. 2024-02-17T23:14:13.787 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: The key fingerprint is: 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: SHA256:fArscdGuOZdqf3JfHGQUYSk3dulOFOI8LpIjGIosvqY ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: The key's randomart image is: 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: +---[RSA 3072]----+ 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: | . **| 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: | . o.+B.| 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: | . . . +*oo| 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: |. . ..o. o. . +o | 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: |.o . .+.S+o. .o. | 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: |o . +.=o.. o.| 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: | . . = o o| 2024-02-17T23:14:13.788 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: | .. .+. o . | 2024-02-17T23:14:13.789 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: |E. ....+ .. | 2024-02-17T23:14:13.789 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:13 smithi005 bash[35426]: +----[SHA256]-----+ 2024-02-17T23:14:14.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'cephadm', 'get-pub-key'] 2024-02-17T23:14:14.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 cephadm get-pub-key 2024-02-17T23:14:14.044 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:14 smithi005 bash[35193]: audit 2024-02-17T23:14:13.309799+0000 mgr.y (mgr.14117) 2 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:14:14.044 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:14 smithi005 bash[35193]: cephadm 2024-02-17T23:14:13.310012+0000 mgr.y (mgr.14117) 3 : cephadm [INF] Generating ssh key... 2024-02-17T23:14:14.044 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:14 smithi005 bash[35193]: audit 2024-02-17T23:14:13.465705+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAtcoWnX0oMyyitjIMaICFuoDeT3RHMTlmR7bbG93KHJNAmhUo6SPz\nU4vKhUc5ttjvO0FYtHg37lwH2NAHgjoDT0fCDVKtTdyqojgq+9BPqToY0l3Z97h38sMQVX\nQPANEz7s+8wvSD6aLzMvQCAsU39YN1J0CvzUXXQkPcBLpkcV+xrjUH9El77hVnFroMFhaF\n8eVQQPLuQVtSTMJBe8blj7Ep6bdrU9RbA5DXegka2eB49a0kKgqZpU0KJ3HK9d4IftM877\nLBULVevGfr4QgzPG+A47cLeExv22z+Nv7ylQ5135O3tEmHD8K83uWEIoU7VqIvNspyySzb\nf8V3RFMfQwp8WEVjw4NKE9MVh0yOCXxrmHIV+NwoXwglEo+fvh4s2czQ6oXWdv/5MGOGjp\nsKe2Qy5KIAzRSrXtDA5f0Jb9W5/d4ALIcJebiAVxFgYsOw+CXhlbbRPocpuiSuVDpg7ZhS\nJBokjC1ziYNxwN80bZ5I9f7/qv1UO5P+lsI5UP0vAAAFoEI4gb9COIG/AAAAB3NzaC1yc2\nEAAAGBALXKFp19KDMsorYyDGiAhbqA3k90RzE5Zke22xvdyhyTQJoVKOkj81OLyoVHObbY\n7ztBWLR4N+5cB9jQB4I6A09Hwg1SrU3cqqI4KvvQT6k6GNJd2fe4d/LDEFV0DwDRM+7PvM\nL0g+mi8zL0AgLFN/WDdSdAr81F10JD3AS6ZHFfsa41B/RJe+4VZxa6DBYWhfHlUEDy7kFb\nUkzCQXvG5Y+xKem3a1PUWwOQ13oJGtngePWtJCoKmaVNCidxyvXeCH7TPO+ywVC1Xrxn6+\nEIMzxvgOO3C3hMb9ts/jb+8pUOdd+Tt7RJhw/CvN7lhCKFO1aiLzbKcsks23/Fd0RTH0MK\nfFhFY8ODShPTFYdMjgl8a5hyFfjcKF8IJRKPn74eLNnM0OqF1nb/+TBjho6bCntkMuSiAM\n0Uq17QwOX9CW/Vuf3eACyHCXm4gFcRYGLDsPgl4ZW20T6HKbokrlQ6YO2YUiQaJIwtc4mD\nccDfNG2eSPX+/6r9VDuT/pbCOVD9LwAAAAMBAAEAAAGAYGnL0L7+QRXdPhARMKNpSV7riO\nw8jcjJjCNY1dCtTrZyPsYWKoAcnyS2xjTeUTGAv8aKizxvPYWly8GZGeI2uydtra85pt/v\nx5VOhrsWZMQhQgDwh0dYpnH6CbhB9Mb/ahrXG/aet5zqqw1qu5lpclbEHYtbMd1mqwheek\nt41gBQtfn+O/t1NPI4+H63xkcvxvk9tRSidBtA7ODh5gm42pq1hfT3gUBQ/PUmstx9VyyM\nOpAXbAyvLFJNnlnlsLyOk48DOG7eDxs+etd951e3s0aYDlS4NdCeDnmldjJFKjdcy9EVvW\nyNM17zxToiXdocEuCWpEcuw6om1+ggD1JntkC3ciQ93jgNGXnkFmFTuoIvVnbiuPSiBCqA\nv60JqmDqEUu53mEZgXmrqnwlgdAd64xisAjmIKm7cPjENOZC6ZkgQeQalcBPf3dO0einr7\nvuNt3tePhVo/kiBGmxarvB/WFtkj0o4evxLVhCrlefjZtw3J6YK0dwmctcbRoUPLmRAAAA\nwEOAhKbivzouUP05mUPKkAzH+LJfzITOoJo+wfuItC33HfDY/TzO7//TCwyAtfBJscTkIQ\nNJ83dqzGda5bwevvlYr8OTFGhUPgPHXRfUP1UxvzgmOBkJrWeE5ENCWymzsQVb5OwQopXm\nMk5fbm82DwsYBDPpKZzyQyaabxJQ7n6GHrYgAYb0zxFBf30axJ17rXYEPL4gF/A6IEIZ0C\nHDPQLTeSUZepgIanF6O/C+kUQzgEUPt9rzZYSSAHPp9PdH5AAAAMEA5pTxHz0uGR6J5XVt\n9ZmA6EvBxiaAFEpgqX9klEctSHnwfDEJKZWEI4zXgPLTOeltcfpwQ+Eb0KfmVIyS/UuKv3\n46m4asUsk/SPLzuTAuAHnp5WtmeiuM7cRz4Hb6BZzG6UnJk84XQUMR2/QBcmkGnxs8DtZn\nmYpTjBZ+tUf/oWMknezA0KKg8D2vqtZim2aYoFz5ex79sOACAiZfdRV+cj9r/8KrESo+Yp\nQXnLb9bK/cdxRPkpHksjGhiAcEFV0bAAAAwQDJ1Dd1/8Wy0HW5hByAUMlBseouMIcSGc5F\nH8H3+sEvjq4rBxslPOWJPFboYp2kLqrIh65qOqxmpuhWlNqeTc6ioDvD4HbBczVldsiFpD\nfhm0bnyfF5Po6e/6GBqCftXmF1vDupEYPTzShZSIdR64RqVAZm7+wmzLPtY1rpDhIDJxsa\n0xc/w+dh4OFPJxu1RwtFajeNnBByVkkDSF+4WaiRcnqNrG5su5DEDcUuykthqKCrpG7EU5\npOAZVALXZDBX0AAAApY2VwaC0xZmZjZGY3ZS1jZGVhLTExZWUtOTViYS04Nzc3NGY2OWE3\nMTUBAg==\n-----END OPENSSH PRIVATE KEY-----\n"}]: dispatch 2024-02-17T23:14:14.044 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:14 smithi005 bash[35193]: audit 2024-02-17T23:14:13.467477+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_key","val":"-----BEGIN OPENSSH PRIVATE KEY-----\nb3BlbnNzaC1rZXktdjEAAAAABG5vbmUAAAAEbm9uZQAAAAAAAAABAAABlwAAAAdzc2gtcn\nNhAAAAAwEAAQAAAYEAtcoWnX0oMyyitjIMaICFuoDeT3RHMTlmR7bbG93KHJNAmhUo6SPz\nU4vKhUc5ttjvO0FYtHg37lwH2NAHgjoDT0fCDVKtTdyqojgq+9BPqToY0l3Z97h38sMQVX\nQPANEz7s+8wvSD6aLzMvQCAsU39YN1J0CvzUXXQkPcBLpkcV+xrjUH9El77hVnFroMFhaF\n8eVQQPLuQVtSTMJBe8blj7Ep6bdrU9RbA5DXegka2eB49a0kKgqZpU0KJ3HK9d4IftM877\nLBULVevGfr4QgzPG+A47cLeExv22z+Nv7ylQ5135O3tEmHD8K83uWEIoU7VqIvNspyySzb\nf8V3RFMfQwp8WEVjw4NKE9MVh0yOCXxrmHIV+NwoXwglEo+fvh4s2czQ6oXWdv/5MGOGjp\nsKe2Qy5KIAzRSrXtDA5f0Jb9W5/d4ALIcJebiAVxFgYsOw+CXhlbbRPocpuiSuVDpg7ZhS\nJBokjC1ziYNxwN80bZ5I9f7/qv1UO5P+lsI5UP0vAAAFoEI4gb9COIG/AAAAB3NzaC1yc2\nEAAAGBALXKFp19KDMsorYyDGiAhbqA3k90RzE5Zke22xvdyhyTQJoVKOkj81OLyoVHObbY\n7ztBWLR4N+5cB9jQB4I6A09Hwg1SrU3cqqI4KvvQT6k6GNJd2fe4d/LDEFV0DwDRM+7PvM\nL0g+mi8zL0AgLFN/WDdSdAr81F10JD3AS6ZHFfsa41B/RJe+4VZxa6DBYWhfHlUEDy7kFb\nUkzCQXvG5Y+xKem3a1PUWwOQ13oJGtngePWtJCoKmaVNCidxyvXeCH7TPO+ywVC1Xrxn6+\nEIMzxvgOO3C3hMb9ts/jb+8pUOdd+Tt7RJhw/CvN7lhCKFO1aiLzbKcsks23/Fd0RTH0MK\nfFhFY8ODShPTFYdMjgl8a5hyFfjcKF8IJRKPn74eLNnM0OqF1nb/+TBjho6bCntkMuSiAM\n0Uq17QwOX9CW/Vuf3eACyHCXm4gFcRYGLDsPgl4ZW20T6HKbokrlQ6YO2YUiQaJIwtc4mD\nccDfNG2eSPX+/6r9VDuT/pbCOVD9LwAAAAMBAAEAAAGAYGnL0L7+QRXdPhARMKNpSV7riO\nw8jcjJjCNY1dCtTrZyPsYWKoAcnyS2xjTeUTGAv8aKizxvPYWly8GZGeI2uydtra85pt/v\nx5VOhrsWZMQhQgDwh0dYpnH6CbhB9Mb/ahrXG/aet5zqqw1qu5lpclbEHYtbMd1mqwheek\nt41gBQtfn+O/t1NPI4+H63xkcvxvk9tRSidBtA7ODh5gm42pq1hfT3gUBQ/PUmstx9VyyM\nOpAXbAyvLFJNnlnlsLyOk48DOG7eDxs+etd951e3s0aYDlS4NdCeDnmldjJFKjdcy9EVvW\nyNM17zxToiXdocEuCWpEcuw6om1+ggD1JntkC3ciQ93jgNGXnkFmFTuoIvVnbiuPSiBCqA\nv60JqmDqEUu53mEZgXmrqnwlgdAd64xisAjmIKm7cPjENOZC6ZkgQeQalcBPf3dO0einr7\nvuNt3tePhVo/kiBGmxarvB/WFtkj0o4evxLVhCrlefjZtw3J6YK0dwmctcbRoUPLmRAAAA\nwEOAhKbivzouUP05mUPKkAzH+LJfzITOoJo+wfuItC33HfDY/TzO7//TCwyAtfBJscTkIQ\nNJ83dqzGda5bwevvlYr8OTFGhUPgPHXRfUP1UxvzgmOBkJrWeE5ENCWymzsQVb5OwQopXm\nMk5fbm82DwsYBDPpKZzyQyaabxJQ7n6GHrYgAYb0zxFBf30axJ17rXYEPL4gF/A6IEIZ0C\nHDPQLTeSUZepgIanF6O/C+kUQzgEUPt9rzZYSSAHPp9PdH5AAAAMEA5pTxHz0uGR6J5XVt\n9ZmA6EvBxiaAFEpgqX9klEctSHnwfDEJKZWEI4zXgPLTOeltcfpwQ+Eb0KfmVIyS/UuKv3\n46m4asUsk/SPLzuTAuAHnp5WtmeiuM7cRz4Hb6BZzG6UnJk84XQUMR2/QBcmkGnxs8DtZn\nmYpTjBZ+tUf/oWMknezA0KKg8D2vqtZim2aYoFz5ex79sOACAiZfdRV+cj9r/8KrESo+Yp\nQXnLb9bK/cdxRPkpHksjGhiAcEFV0bAAAAwQDJ1Dd1/8Wy0HW5hByAUMlBseouMIcSGc5F\nH8H3+sEvjq4rBxslPOWJPFboYp2kLqrIh65qOqxmpuhWlNqeTc6ioDvD4HbBczVldsiFpD\nfhm0bnyfF5Po6e/6GBqCftXmF1vDupEYPTzShZSIdR64RqVAZm7+wmzLPtY1rpDhIDJxsa\n0xc/w+dh4OFPJxu1RwtFajeNnBByVkkDSF+4WaiRcnqNrG5su5DEDcUuykthqKCrpG7EU5\npOAZVALXZDBX0AAAApY2VwaC0xZmZjZGY3ZS1jZGVhLTExZWUtOTViYS04Nzc3NGY2OWE3\nMTUBAg==\n-----END OPENSSH PRIVATE KEY-----\n"}]': finished 2024-02-17T23:14:14.044 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:14 smithi005 bash[35193]: audit 2024-02-17T23:14:13.467848+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1yhadfSgzLKK2MgxogIW6gN5PdEcxOWZHttsb3cock0CaFSjpI/NTi8qFRzm22O87QVi0eDfuXAfY0AeCOgNPR8INUq1N3KqiOCr70E+pOhjSXdn3uHfywxBVdA8A0TPuz7zC9IPpovMy9AICxTf1g3UnQK/NRddCQ9wEumRxX7GuNQf0SXvuFWcWugwWFoXx5VBA8u5BW1JMwkF7xuWPsSnpt2tT1FsDkNd6CRrZ4Hj1rSQqCpmlTQonccr13gh+0zzvssFQtV68Z+vhCDM8b4Djtwt4TG/bbP42/vKVDnXfk7e0SYcPwrze5YQihTtWoi82ynLJLNt/xXdEUx9DCnxYRWPDg0oT0xWHTI4JfGuYchX43ChfCCUSj5++HizZzNDqhdZ2//kwY4aOmwp7ZDLkogDNFKte0MDl/Qlv1bn93gAshwl5uIBXEWBiw7D4JeGVttE+hym6JK5UOmDtmFIkGiSMLXOJg3HA3zRtnkj1/v+q/VQ7k/6WwjlQ/S8= ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715\n"}]: dispatch 2024-02-17T23:14:14.044 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:14 smithi005 bash[35193]: audit 2024-02-17T23:14:13.469012+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/ssh_identity_pub","val":"ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1yhadfSgzLKK2MgxogIW6gN5PdEcxOWZHttsb3cock0CaFSjpI/NTi8qFRzm22O87QVi0eDfuXAfY0AeCOgNPR8INUq1N3KqiOCr70E+pOhjSXdn3uHfywxBVdA8A0TPuz7zC9IPpovMy9AICxTf1g3UnQK/NRddCQ9wEumRxX7GuNQf0SXvuFWcWugwWFoXx5VBA8u5BW1JMwkF7xuWPsSnpt2tT1FsDkNd6CRrZ4Hj1rSQqCpmlTQonccr13gh+0zzvssFQtV68Z+vhCDM8b4Djtwt4TG/bbP42/vKVDnXfk7e0SYcPwrze5YQihTtWoi82ynLJLNt/xXdEUx9DCnxYRWPDg0oT0xWHTI4JfGuYchX43ChfCCUSj5++HizZzNDqhdZ2//kwY4aOmwp7ZDLkogDNFKte0MDl/Qlv1bn93gAshwl5uIBXEWBiw7D4JeGVttE+hym6JK5UOmDtmFIkGiSMLXOJg3HA3zRtnkj1/v+q/VQ7k/6WwjlQ/S8= ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715\n"}]': finished 2024-02-17T23:14:14.767 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1yhadfSgzLKK2MgxogIW6gN5PdEcxOWZHttsb3cock0CaFSjpI/NTi8qFRzm22O87QVi0eDfuXAfY0AeCOgNPR8INUq1N3KqiOCr70E+pOhjSXdn3uHfywxBVdA8A0TPuz7zC9IPpovMy9AICxTf1g3UnQK/NRddCQ9wEumRxX7GuNQf0SXvuFWcWugwWFoXx5VBA8u5BW1JMwkF7xuWPsSnpt2tT1FsDkNd6CRrZ4Hj1rSQqCpmlTQonccr13gh+0zzvssFQtV68Z+vhCDM8b4Djtwt4TG/bbP42/vKVDnXfk7e0SYcPwrze5YQihTtWoi82ynLJLNt/xXdEUx9DCnxYRWPDg0oT0xWHTI4JfGuYchX43ChfCCUSj5++HizZzNDqhdZ2//kwY4aOmwp7ZDLkogDNFKte0MDl/Qlv1bn93gAshwl5uIBXEWBiw7D4JeGVttE+hym6JK5UOmDtmFIkGiSMLXOJg3HA3zRtnkj1/v+q/VQ7k/6WwjlQ/S8= ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:14:15.356 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2024-02-17T23:14:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Adding key to root@localhost's authorized_keys... 2024-02-17T23:14:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Adding host smithi005... 2024-02-17T23:14:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'orch', 'host', 'add', 'smithi005'] 2024-02-17T23:14:15.357 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 orch host add smithi005 2024-02-17T23:14:15.875 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:15 smithi005 bash[35193]: audit 2024-02-17T23:14:14.766615+0000 mgr.y (mgr.14117) 4 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:14:16.375 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:16 smithi005 bash[35426]: Warning: Permanently added 'smithi005,172.21.15.5' (ECDSA) to the list of known hosts. 2024-02-17T23:14:17.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Added host 'smithi005' 2024-02-17T23:14:17.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:16 smithi005 bash[35193]: audit 2024-02-17T23:14:16.093997+0000 mgr.y (mgr.14117) 5 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi005", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:14:17.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:16 smithi005 bash[35193]: audit 2024-02-17T23:14:16.597147+0000 mon.a (mon.0) 59 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"smithi005\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:14:17.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:16 smithi005 bash[35193]: audit 2024-02-17T23:14:16.598876+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"smithi005\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-17T23:14:17.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:16 smithi005 bash[35193]: cephadm 2024-02-17T23:14:16.599211+0000 mgr.y (mgr.14117) 6 : cephadm [INF] Added host smithi005 2024-02-17T23:14:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:17 smithi005 bash[35193]: audit 2024-02-17T23:14:16.828002+0000 mon.a (mon.0) 61 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:14:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:17 smithi005 bash[35193]: audit 2024-02-17T23:14:16.829652+0000 mon.a (mon.0) 62 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:14:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:17 smithi005 bash[35193]: audit 2024-02-17T23:14:16.830161+0000 mon.a (mon.0) 63 : audit [DBG] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:14:18.474 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Enabling the dashboard module... 2024-02-17T23:14:18.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'module', 'enable', 'dashboard'] 2024-02-17T23:14:18.475 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr module enable dashboard 2024-02-17T23:14:18.750 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:18 smithi005 bash[35193]: audit 2024-02-17T23:14:18.199655+0000 mon.a (mon.0) 64 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:18.197819\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:18.198953\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-17T23:14:18.199036\", \"networks\": {}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:14:18.751 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:18 smithi005 bash[35193]: audit 2024-02-17T23:14:18.201407+0000 mon.a (mon.0) 65 : audit [INF] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:18.197819\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:18.198953\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-17T23:14:18.199036\", \"networks\": {}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:14:18.751 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:18 smithi005 bash[35193]: audit 2024-02-17T23:14:18.201895+0000 mon.a (mon.0) 66 : audit [DBG] from='mgr.14117 172.21.15.5:0/1106103682' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:14:19.744 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:19 smithi005 bash[35193]: audit 2024-02-17T23:14:19.242949+0000 mon.a (mon.0) 67 : audit [INF] from='client.? 172.21.15.5:0/887496483' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-02-17T23:14:20.107 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:19 smithi005 bash[35426]: ignoring --setuser ceph since I am not root 2024-02-17T23:14:20.108 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:19 smithi005 bash[35426]: ignoring --setgroup ceph since I am not root 2024-02-17T23:14:20.435 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'mgr', 'dump'] 2024-02-17T23:14:20.436 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 mgr dump 2024-02-17T23:14:21.018 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:20 smithi005 bash[35193]: audit 2024-02-17T23:14:19.716385+0000 mon.a (mon.0) 68 : audit [INF] from='client.? 172.21.15.5:0/887496483' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-02-17T23:14:21.018 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:20 smithi005 bash[35193]: cluster 2024-02-17T23:14:19.716425+0000 mon.a (mon.0) 69 : cluster [DBG] mgrmap e9: y(active, since 18s) 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "epoch": 9, 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_gid": 14117, 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_name": "y", 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addrs": { 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.5:6800", 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1225164636 2024-02-17T23:14:22.014 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v1", 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.5:6801", 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1225164636 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_addr": "172.21.15.5:6801/1225164636", 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_change": "2024-02-17T23:14:01.424498+0000", 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_mgr_features": 4540138292836696063, 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available": true, 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standbys": [], 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "modules": [ 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "dashboard", 2024-02-17T23:14:22.015 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "iostat", 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "restful" 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "available_modules": [ 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "alerts", 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.016 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "How frequently to reexamine health status", 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.017 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.018 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.019 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.020 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.021 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_destination": { 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_destination", 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email address to send alerts to", 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.022 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_from_name": { 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_from_name", 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "Ceph", 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Email From: name", 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_host": { 2024-02-17T23:14:22.023 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_host", 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP server", 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_password": { 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_password", 2024-02-17T23:14:22.024 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Password to authenticate with", 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_port": { 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_port", 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.025 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "465", 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP port", 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_sender": { 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_sender", 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.026 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "SMTP envelope sender", 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_ssl": { 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_ssl", 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.027 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Use SSL to connect to SMTP server", 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "smtp_user": { 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "smtp_user", 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.028 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "User to authenticate as", 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.029 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "balancer", 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active": { 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "active", 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically balance PGs across cluster", 2024-02-17T23:14:22.030 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_time": { 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_time", 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0000", 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "beginning time of day to automatically balance", 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.031 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "begin_weekday": { 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "begin_weekday", 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to this day of the week or later", 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.032 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_max_iterations": { 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_max_iterations", 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "25", 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "250", 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum number of iterations to attempt optimization", 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_metrics": { 2024-02-17T23:14:22.033 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_metrics", 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "pgs,objects,bytes", 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "metrics with which to calculate OSD utilization", 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush_compat_step": { 2024-02-17T23:14:22.034 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crush_compat_step", 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0.5", 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0.001", 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "0.999", 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "aggressiveness of optimization", 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_time": { 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_time", 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.035 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2400", 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "ending time of day to automatically balance", 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "This is a time of day in the format HHMM.", 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "end_weekday": { 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "end_weekday", 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.036 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "0", 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "7", 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.038 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.039 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.040 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.041 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_score": { 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_score", 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "minimum score, below which no optimization is attempted", 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-17T23:14:22.042 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "none", 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crush-compat", 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "none", 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap" 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Balancer mode", 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.043 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_ids": { 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_ids", 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.044 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "pools which the automatic balancing will be limited to", 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and attempt optimization", 2024-02-17T23:14:22.045 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_deviation": { 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_deviation", 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "1", 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "deviation below which no optimization is attempted", 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.046 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "upmap_max_optimizations": { 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "upmap_max_optimizations", 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "uint", 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "maximum upmap optimizations to make per attempt", 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.047 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "cephadm", 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "allow_ptrace": { 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "allow_ptrace", 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.048 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "allow SYS_PTRACE capability on ceph containers", 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "container_image_base": { 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "container_image_base", 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph/ceph", 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.049 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Container image name, without the tag", 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "daemon_cache_timeout": { 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "daemon_cache_timeout", 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache service (daemon) inventory", 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.050 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_cache_timeout": { 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_cache_timeout", 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1800", 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "seconds to cache device inventory", 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.051 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "host_check_interval": { 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "host_check_interval", 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to perform a host check", 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.052 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.053 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "log to the \"cephadm\" cluster log channel\"", 2024-02-17T23:14:22.054 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.055 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.056 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mode": { 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mode", 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "root", 2024-02-17T23:14:22.057 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm-package", 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "root" 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "mode for remote execution of cephadm", 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssh_config_file": { 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssh_config_file", 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.058 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "customized SSH config file to connect to managed hosts", 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_failed_host_check": { 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_failed_host_check", 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.059 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if the host check fails", 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_daemons": { 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_daemons", 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.060 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_on_stray_hosts": { 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_on_stray_hosts", 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.061 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crash", 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.062 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.063 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.064 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.065 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.066 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retain_interval": { 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retain_interval", 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "31536000", 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain crashes before pruning them", 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_recent_interval": { 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_recent_interval", 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1209600", 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "time interval in which to warn about recent crashes", 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.068 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "dashboard", 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ALERTMANAGER_API_HOST": { 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ALERTMANAGER_API_HOST", 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.069 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_ENABLED": { 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_ENABLED", 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.070 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "AUDIT_API_LOG_PAYLOAD": { 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "AUDIT_API_LOG_PAYLOAD", 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.071 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ENABLE_BROWSABLE_API": { 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ENABLE_BROWSABLE_API", 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.072 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_cephfs": { 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_cephfs", 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_iscsi": { 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_iscsi", 2024-02-17T23:14:22.073 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_mirroring": { 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_mirroring", 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.074 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_nfs": { 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_nfs", 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.075 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rbd": { 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rbd", 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.076 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "FEATURE_TOGGLE_rgw": { 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "FEATURE_TOGGLE_rgw", 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.077 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.078 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_PASSWORD": { 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_PASSWORD", 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.079 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_SSL_VERIFY": { 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_SSL_VERIFY", 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.080 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_URL": { 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_URL", 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_API_USERNAME": { 2024-02-17T23:14:22.081 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_API_USERNAME", 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "GRAFANA_UPDATE_DASHBOARDS": { 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-02-17T23:14:22.082 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ISCSI_API_SSL_VERIFICATION": { 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ISCSI_API_SSL_VERIFICATION", 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.083 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PROMETHEUS_API_HOST": { 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PROMETHEUS_API_HOST", 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.084 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.085 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.086 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.087 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.088 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.089 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.090 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.091 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_ENABLED": { 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_ENABLED", 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.092 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_EXCLUSION_LIST": { 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_EXCLUSION_LIST", 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.093 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_COMPLEXITY": { 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "PWD_POLICY_MIN_LENGTH": { 2024-02-17T23:14:22.094 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "PWD_POLICY_MIN_LENGTH", 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8", 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "REST_REQUESTS_TIMEOUT": { 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "REST_REQUESTS_TIMEOUT", 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.095 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "45", 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ACCESS_KEY": { 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ACCESS_KEY", 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.096 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_ADMIN_RESOURCE": { 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_ADMIN_RESOURCE", 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.097 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "admin", 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_HOST": { 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_HOST", 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.098 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_PORT": { 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_PORT", 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "80", 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.099 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SCHEME": { 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SCHEME", 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.100 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "http", 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SECRET_KEY": { 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SECRET_KEY", 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.101 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_SSL_VERIFY": { 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_SSL_VERIFY", 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.102 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "RGW_API_USER_ID": { 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "RGW_API_USER_ID", 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.103 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_SPAN": { 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_SPAN", 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "0", 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.104 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_1": { 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.105 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "USER_PWD_EXPIRATION_WARNING_2": { 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.106 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crt_file": { 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "crt_file", 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.107 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug": { 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "debug", 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Enable/disable debug options", 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.108 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "jwt_token_ttl": { 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "jwt_token_ttl", 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "28800", 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.109 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.111 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.112 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.113 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.114 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.115 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.116 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "::", 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.117 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8080", 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.118 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl_server_port": { 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl_server_port", 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8443", 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.119 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_behaviour": { 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_behaviour", 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "redirect", 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.120 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "redirect" 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "standby_error_status_code": { 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "standby_error_status_code", 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.121 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "500", 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "400", 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "599", 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url_prefix": { 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url_prefix", 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.122 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.123 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "devicehealth", 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enable_monitoring": { 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enable_monitoring", 2024-02-17T23:14:22.124 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "monitor device health metrics", 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.125 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.126 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.127 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.128 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.129 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mark_out_threshold": { 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mark_out_threshold", 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.130 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "2419200", 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "automatically mark OSD if it may fail before this long", 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pool_name": { 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pool_name", 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "device_health_metrics", 2024-02-17T23:14:22.131 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name of pool in which to store device health metrics", 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "retention_period": { 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "retention_period", 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15552000", 2024-02-17T23:14:22.132 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how long to retain device health metrics", 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_frequency": { 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_frequency", 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.133 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to scrape device health metrics", 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "self_heal": { 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "self_heal", 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.134 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "preemptively heal cluster around devices that may fail", 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.135 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to wake up and check device health", 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warn_threshold": { 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "warn_threshold", 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7257600", 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.136 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "raise health warning if OSD may fail before this long", 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "diskprediction_local", 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.137 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.138 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.139 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.140 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.141 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predict_interval": { 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predict_interval", 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "86400", 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.142 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "predictor_model": { 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "predictor_model", 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "prophetstor", 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.143 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "600", 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.144 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "influx", 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": false, 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "influxdb python module not found", 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "batch_size": { 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "batch_size", 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5000", 2024-02-17T23:14:22.145 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "database": { 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "database", 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "ceph", 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.146 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "hostname": { 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "hostname", 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.147 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "30", 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.148 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.149 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.150 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.151 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.152 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "password": { 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "password", 2024-02-17T23:14:22.153 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "port": { 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "port", 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.154 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "8086", 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ssl": { 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ssl", 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.155 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "false", 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "threads": { 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "threads", 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-17T23:14:22.156 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "username": { 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "username", 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.157 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "verify_ssl": { 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "verify_ssl", 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "true", 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.158 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "insights", 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.159 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.160 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.161 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.162 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.163 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "iostat", 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.164 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.165 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.166 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.167 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.168 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "k8sevents", 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.169 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "ceph_event_retention_days": { 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "ceph_event_retention_days", 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "7", 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Days to hold ceph event information within local cache", 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.170 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "config_check_secs": { 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "config_check_secs", 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10", 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "10", 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "interval (secs) to check for cluster configuration changes", 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.171 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.172 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.173 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.174 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.175 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "localpool", 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "failure_domain": { 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "failure_domain", 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.176 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "host", 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "failure domain for any created local pool", 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.177 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.178 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.179 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.180 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.181 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min_size": { 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "min_size", 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default min_size for any created local pool", 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.182 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "num_rep": { 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "num_rep", 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "3", 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default replica count for any created local pool", 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_num": { 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_num", 2024-02-17T23:14:22.183 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "128", 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "default pg_num for any created local pool", 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "prefix": { 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prefix", 2024-02-17T23:14:22.184 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "name prefix for any created local pool", 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "subtree": { 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "subtree", 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.185 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "rack", 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "CRUSH level for which to create a local pool", 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.186 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.187 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.188 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.189 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.190 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator": { 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "orchestrator", 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.191 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "cephadm", 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rook", 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "test_orchestrator" 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Orchestrator backend", 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "osd_support", 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.192 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.193 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.194 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.195 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.196 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "pg_autoscaler", 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.197 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.198 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.199 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.200 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.201 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "sleep_interval": { 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "sleep_interval", 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-17T23:14:22.202 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "progress", 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.203 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.204 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.205 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.206 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.207 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max_completed_events": { 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "max_completed_events", 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.208 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "50", 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "number of past completed events to remember", 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "persist_interval": { 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "persist_interval", 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "5", 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.209 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "how frequently to persist completed events", 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "prometheus", 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.210 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.211 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.212 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.213 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.214 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools": { 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools", 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.215 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_stats_pools_refresh_interval": { 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_stats_pools_refresh_interval", 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.216 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "scrape_interval": { 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "scrape_interval", 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.217 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.218 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.219 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rbd_support", 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.220 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.221 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.222 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.223 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.224 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mirror_snapshot_schedule": { 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "mirror_snapshot_schedule", 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "trash_purge_schedule": { 2024-02-17T23:14:22.225 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "trash_purge_schedule", 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.226 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "restful", 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "key_file": { 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "key_file", 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.227 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.228 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.229 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.230 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.231 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_addr": { 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_addr", 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.232 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "server_port": { 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "server_port", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.233 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rook", 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.234 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.235 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.236 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.237 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.238 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "selftest", 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.239 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.240 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.241 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.242 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.243 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption1": { 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption1", 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.244 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "roption2": { 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "roption2", 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "xyz", 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.245 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption1": { 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption1", 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.246 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption2": { 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption2", 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.247 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption3": { 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption3", 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "float", 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.248 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption4": { 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption4", 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.249 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption5": { 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption5", 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.250 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rwoption6": { 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "rwoption6", 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testkey": { 2024-02-17T23:14:22.251 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testkey", 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testlkey": { 2024-02-17T23:14:22.252 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testlkey", 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "testnewline": { 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "testnewline", 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.253 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "status", 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.254 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.255 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.256 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.257 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.258 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telegraf", 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.259 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "address": { 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "address", 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "unixgram:///tmp/telegraf.sock", 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-17T23:14:22.260 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "15", 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.261 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.262 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.263 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.264 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.265 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "telemetry", 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_basic": { 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_basic", 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.266 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "Share basic cluster information (size, version)", 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_crash": { 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_crash", 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.267 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_device": { 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_device", 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "True", 2024-02-17T23:14:22.268 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "channel_ident": { 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "channel_ident", 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.269 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "contact": { 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "contact", 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.270 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "description": { 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "description", 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.271 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "device_url": { 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "device_url", 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/device", 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enabled": { 2024-02-17T23:14:22.272 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "enabled", 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.273 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "24", 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "8", 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_opt_revision": { 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "last_opt_revision", 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.274 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "1", 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "leaderboard": { 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "leaderboard", 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.275 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.276 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.277 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.278 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.279 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.280 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "organization": { 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "organization", 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.281 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "proxy": { 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "proxy", 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "url": { 2024-02-17T23:14:22.282 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "url", 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "https://telemetry.ceph.com/report", 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.283 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "test_orchestrator", 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.284 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.285 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.286 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.287 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.288 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "volumes", 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.289 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.290 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.291 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.292 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix", 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "can_run": true, 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error_string": "", 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "module_options": { 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "discovery_interval": { 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "discovery_interval", 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "100", 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.294 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "identifier": { 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "identifier", 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.295 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "interval": { 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "interval", 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "secs", 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "60", 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.296 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_level": { 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_level", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.297 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster": { 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster", 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.298 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_cluster_level": { 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_cluster_level", 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "info", 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [ 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "", 2024-02-17T23:14:22.299 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "critical", 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "debug", 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "error", 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "info", 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "warning" 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "log_to_file": { 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "log_to_file", 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "bool", 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 1, 2024-02-17T23:14:22.300 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "False", 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_host": { 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_host", 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "None", 2024-02-17T23:14:22.301 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_port": { 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_port", 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "int", 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "10051", 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.302 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "zabbix_sender": { 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "name": "zabbix_sender", 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "str", 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "level": "advanced", 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "flags": 0, 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "default_value": "/usr/bin/zabbix_sender", 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "min": "", 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "max": "", 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "enum_allowed": [], 2024-02-17T23:14:22.303 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "desc": "", 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "long_desc": "", 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "tags": [], 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "see_also": [] 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "services": {}, 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "always_on_modules": { 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nautilus": [ 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator_cli", 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-17T23:14:22.304 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "octopus": [ 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "balancer", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "crash", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "devicehealth", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "orchestrator", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "osd_support", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "pg_autoscaler", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "progress", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "rbd_support", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "status", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "telemetry", 2024-02-17T23:14:22.305 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "volumes" 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ], 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "last_failure_osd_epoch": 4, 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "active_clients": [ 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.5:0", 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1962775691 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.306 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.5:0", 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1627243195 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout }, 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addrvec": [ 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "type": "v2", 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "addr": "172.21.15.5:0", 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "nonce": 1056227574 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.307 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout ] 2024-02-17T23:14:22.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.308 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:22.308 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:21 smithi005 bash[35193]: audit 2024-02-17T23:14:21.624055+0000 mon.a (mon.0) 70 : audit [DBG] from='client.? 172.21.15.5:0/2901919723' entity='client.admin' cmd=[{"prefix": "mgr dump"}]: dispatch 2024-02-17T23:14:23.110 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Waiting for the mgr to restart... 2024-02-17T23:14:23.110 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Waiting for Mgr epoch 9... 2024-02-17T23:14:23.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'tell', 'mgr', 'mgr_status'] 2024-02-17T23:14:23.110 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 tell mgr mgr_status 2024-02-17T23:14:24.046 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:23 smithi005 bash[35426]: Warning: Permanently added 'smithi005,172.21.15.5' (ECDSA) to the list of known hosts. 2024-02-17T23:14:24.046 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:23 smithi005 bash[35193]: cluster 2024-02-17T23:14:23.593121+0000 mon.a (mon.0) 71 : cluster [INF] Active manager daemon y restarted 2024-02-17T23:14:24.046 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:23 smithi005 bash[35193]: cluster 2024-02-17T23:14:23.593531+0000 mon.a (mon.0) 72 : cluster [INF] Activating manager daemon y 2024-02-17T23:14:24.046 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:23 smithi005 bash[35193]: cluster 2024-02-17T23:14:23.595107+0000 mon.a (mon.0) 73 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-02-17T23:14:24.661 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout { 2024-02-17T23:14:24.661 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "mgrmap_epoch": 11, 2024-02-17T23:14:24.661 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout "initialized": true 2024-02-17T23:14:24.661 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout } 2024-02-17T23:14:25.073 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: cluster 2024-02-17T23:14:23.645581+0000 mon.a (mon.0) 74 : cluster [DBG] mgrmap e10: y(active, starting, since 0.052125s) 2024-02-17T23:14:25.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.648389+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:14:25.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.648583+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:14:25.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.648721+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:14:25.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.648856+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:14:25.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.649150+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:14:25.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.649693+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi005"}]: dispatch 2024-02-17T23:14:25.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.649905+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-17T23:14:25.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.650136+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-17T23:14:25.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.650344+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-17T23:14:25.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.650556+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:14:25.075 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.650754+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:14:25.075 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: cluster 2024-02-17T23:14:23.664392+0000 mon.a (mon.0) 86 : cluster [INF] Manager daemon y is now available 2024-02-17T23:14:25.075 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:23.686767+0000 mon.a (mon.0) 87 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-02-17T23:14:25.075 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:24.572703+0000 mon.a (mon.0) 88 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-02-17T23:14:25.075 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:24 smithi005 bash[35193]: audit 2024-02-17T23:14:24.573108+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:14:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Generating a dashboard self-signed certificate... 2024-02-17T23:14:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'create-self-signed-cert'] 2024-02-17T23:14:25.620 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard create-self-signed-cert 2024-02-17T23:14:25.875 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:25 smithi005 bash[35193]: cluster 2024-02-17T23:14:24.650471+0000 mon.a (mon.0) 90 : cluster [DBG] mgrmap e11: y(active, since 1.05702s) 2024-02-17T23:14:26.392 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout Self-signed certificate created 2024-02-17T23:14:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Creating initial admin user... 2024-02-17T23:14:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'dashboard', 'ac-user-create', 'admin', 'mq09sonix2', 'administrator', '--force-password', '--pwd-update-required'] 2024-02-17T23:14:27.037 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 dashboard ac-user-create admin mq09sonix2 administrator --force-password --pwd-update-required 2024-02-17T23:14:27.041 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:26 smithi005 bash[35193]: cluster 2024-02-17T23:14:25.655343+0000 mon.a (mon.0) 91 : cluster [DBG] mgrmap e12: y(active, since 2s) 2024-02-17T23:14:27.041 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:26 smithi005 bash[35193]: audit 2024-02-17T23:14:26.387895+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCEC0gbVtwSEZVupDULRaow2EwDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTI0MDIxNzIzMTQy\nNloXDTM0MDIxNDIzMTQyNlowJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAm4zC7Pu3\nR0AiZ1RLc1uB6nzcvcGmWE9tReD45RI+LYOnRz6OHCMbSvf9LnQCDRBLfjkGKQHn\nhvkxrsaJZ8geRXmBkx6aoaU2hEm6IP0IlJ9HpTRHrmGzSM3Fz0Kvlo8+AgjtdodB\nbZpuYo9aXylZT7ic8rqpsVC9JesL17fSiIikZwPCXDw6/cnz89oXzYfPbLY4r6GB\nJixccPHBJjhIGQUUowGFqDOHMFSGvv2A0M98sJxeOy3AGSnumGom3nSZAZJGNq4D\nVKPXDjQGNJS7Gq27Z5BNUrv9twnvjSBcGqdouH7XMM0zxM6TDJHLvh676hJynyWC\npmtCBcg47jhs4QIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQAtZ8/Zj54rY4d6DX2P\nR5eeBxIyHtvWpLeOyQobmgtH+J4m2i2p8JsTeTGs7P1+rAK7G0U+j6MbgL8nNAMC\n/FFR1mCwLy0ZgFQGA93ilGo/9Dr4VqcThLnkQ0bBeNHsq+lfXjQ9HC+yFps+eH/t\nZsK4jHNqJKknHOBH7MDdLQr1RSNYGaZcYG3IeYaJOrmupL93D4jGgec/730xRN9E\nZFH49BPcVoaRdZgghCfF1BvxBa9C4lIJCJkUdn/qLpCPNCGKt0oTkplq/VpoOiAW\n/gjo/+8l1ekcl3Vv/bhu/kCVQM9w81KTA3Ntwapym3bXvIDhH+HgFhXKHaAR7CzK\nb8de\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-17T23:14:27.042 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:26 smithi005 bash[35193]: audit 2024-02-17T23:14:26.389575+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/crt","val":"-----BEGIN CERTIFICATE-----\nMIICzzCCAbcCEC0gbVtwSEZVupDULRaow2EwDQYJKoZIhvcNAQENBQAwJjELMAkG\nA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgtZGFzaGJvYXJkMB4XDTI0MDIxNzIzMTQy\nNloXDTM0MDIxNDIzMTQyNlowJjELMAkGA1UECgwCSVQxFzAVBgNVBAMMDmNlcGgt\nZGFzaGJvYXJkMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAm4zC7Pu3\nR0AiZ1RLc1uB6nzcvcGmWE9tReD45RI+LYOnRz6OHCMbSvf9LnQCDRBLfjkGKQHn\nhvkxrsaJZ8geRXmBkx6aoaU2hEm6IP0IlJ9HpTRHrmGzSM3Fz0Kvlo8+AgjtdodB\nbZpuYo9aXylZT7ic8rqpsVC9JesL17fSiIikZwPCXDw6/cnz89oXzYfPbLY4r6GB\nJixccPHBJjhIGQUUowGFqDOHMFSGvv2A0M98sJxeOy3AGSnumGom3nSZAZJGNq4D\nVKPXDjQGNJS7Gq27Z5BNUrv9twnvjSBcGqdouH7XMM0zxM6TDJHLvh676hJynyWC\npmtCBcg47jhs4QIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQAtZ8/Zj54rY4d6DX2P\nR5eeBxIyHtvWpLeOyQobmgtH+J4m2i2p8JsTeTGs7P1+rAK7G0U+j6MbgL8nNAMC\n/FFR1mCwLy0ZgFQGA93ilGo/9Dr4VqcThLnkQ0bBeNHsq+lfXjQ9HC+yFps+eH/t\nZsK4jHNqJKknHOBH7MDdLQr1RSNYGaZcYG3IeYaJOrmupL93D4jGgec/730xRN9E\nZFH49BPcVoaRdZgghCfF1BvxBa9C4lIJCJkUdn/qLpCPNCGKt0oTkplq/VpoOiAW\n/gjo/+8l1ekcl3Vv/bhu/kCVQM9w81KTA3Ntwapym3bXvIDhH+HgFhXKHaAR7CzK\nb8de\n-----END CERTIFICATE-----\n"}]': finished 2024-02-17T23:14:27.042 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:26 smithi005 bash[35193]: audit 2024-02-17T23:14:26.389905+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCbjMLs+7dHQCJn\nVEtzW4HqfNy9waZYT21F4PjlEj4tg6dHPo4cIxtK9/0udAINEEt+OQYpAeeG+TGu\nxolnyB5FeYGTHpqhpTaESbog/QiUn0elNEeuYbNIzcXPQq+Wjz4CCO12h0Ftmm5i\nj1pfKVlPuJzyuqmxUL0l6wvXt9KIiKRnA8JcPDr9yfPz2hfNh89stjivoYEmLFxw\n8cEmOEgZBRSjAYWoM4cwVIa+/YDQz3ywnF47LcAZKe6YaibedJkBkkY2rgNUo9cO\nNAY0lLsarbtnkE1Su/23Ce+NIFwap2i4ftcwzTPEzpMMkcu+HrvqEnKfJYKma0IF\nyDjuOGzhAgMBAAECggEAduTftV4tV/OomExxI2qFYeMwooYbDJMhVfFArW8FQarI\nuIcS/mTDHslwpwoa6ztSSNdzYvLGsn9Uv1+XdVEb+kSGixowXW+3vOPRthdScK9S\nhu7v/1VEQVivYt148t7oKYwDXb7CfvE0gHdMP0KOtoXIyStuO08YVJxVP/yMmriN\nyZKpBbioEk7QAUNH9W7KmXkREuEGxOPtZs3susw+mFHBCb96TLQ5GpYXpojJxN4E\n8SdmQ8bHui4i1R43yokGuZx+xUJO8rG/ln09MUXKBP3lfttITIKDvJ0v4OOB5QQz\ndjARN++i8KBcApBK5DAEwo2g/t9XPEBdOfEW8Y3IdQKBgQDIZDk9pLwmxqXuFZQC\nDA6tXBCpDBHZjYN/JFkOVzFTcbhq45/X6q/kuE5qKbNzoVSzKryEwT9opU7FDbI5\nnVXtQxNwYxqTDz20gWLFNoRXtBqOzVJNXtAsutYogKVormQPH3rTIApCDChfkmLn\n+WXTPbml/F+xhLPnAYq9rFc2jwKBgQDGtv68Aql4TKv8bHYrImkKOnPINl1dNVlU\nDZpUwv35euSBF04TFzdOJtpWzHhbLGI+Em6EXX7566WUI++Z2OW2jK/8bWLWMdzz\n2BNPA1VBfRJcmf4vLMLS5VVLdMdEWZqrqkgGNjzMqzo/tQN9NBc1PvcIZThfiva7\nwwNoCeFdjwKBgDVqKavZxmFboA0naU1mY18oZDR7SCLCSuPQD4D4EujYLj0nsYq/\nPuVrj1NTDEdtIIOlh5ynWjyNm8KA1Rnwa2AT+hGCCSpb7Km5t1c0IfCyzEV2S1Le\nTAUwRDeFmxGdMoSpcnbmWnWigfx/q6eD3fWBxYOOEv/hjIat7YqDbrfXAoGAeGYP\n2aJTRAxQeFTPFDt5ITVhSYGG+B6GzSKgy5KJh0sqf/y61V5PqA5qZATnN3ag37MT\nOyfa81oPrL5JQhHkvMJpLqyoIdd8ZFIbANioI1HAelLja3nXYSiKkXlj8snHqRM3\nKGxcUjW8yTTHtGiHVz+bNX7+tQThkcoKmlLCNYkCgYB6WLehQtFHvJ/ZXWbfEXBI\nQOrhfTLXfgRwe+zm/r9682DI9PoMcgs6hHUELIiJs33gSEK1YeQtvqWqSZUmqKYi\nKwJiAC3K50/x4fAnvq+vd1F514g08yIVXhGNA1x0kGY8wE/gpLI7v1qCRE160Gv3\n+y4uFuekLaE2u3kFhxL3yQ==\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-17T23:14:27.042 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:26 smithi005 bash[35193]: audit 2024-02-17T23:14:26.391122+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvAIBADANBgkqhkiG9w0BAQEFAASCBKYwggSiAgEAAoIBAQCbjMLs+7dHQCJn\nVEtzW4HqfNy9waZYT21F4PjlEj4tg6dHPo4cIxtK9/0udAINEEt+OQYpAeeG+TGu\nxolnyB5FeYGTHpqhpTaESbog/QiUn0elNEeuYbNIzcXPQq+Wjz4CCO12h0Ftmm5i\nj1pfKVlPuJzyuqmxUL0l6wvXt9KIiKRnA8JcPDr9yfPz2hfNh89stjivoYEmLFxw\n8cEmOEgZBRSjAYWoM4cwVIa+/YDQz3ywnF47LcAZKe6YaibedJkBkkY2rgNUo9cO\nNAY0lLsarbtnkE1Su/23Ce+NIFwap2i4ftcwzTPEzpMMkcu+HrvqEnKfJYKma0IF\nyDjuOGzhAgMBAAECggEAduTftV4tV/OomExxI2qFYeMwooYbDJMhVfFArW8FQarI\nuIcS/mTDHslwpwoa6ztSSNdzYvLGsn9Uv1+XdVEb+kSGixowXW+3vOPRthdScK9S\nhu7v/1VEQVivYt148t7oKYwDXb7CfvE0gHdMP0KOtoXIyStuO08YVJxVP/yMmriN\nyZKpBbioEk7QAUNH9W7KmXkREuEGxOPtZs3susw+mFHBCb96TLQ5GpYXpojJxN4E\n8SdmQ8bHui4i1R43yokGuZx+xUJO8rG/ln09MUXKBP3lfttITIKDvJ0v4OOB5QQz\ndjARN++i8KBcApBK5DAEwo2g/t9XPEBdOfEW8Y3IdQKBgQDIZDk9pLwmxqXuFZQC\nDA6tXBCpDBHZjYN/JFkOVzFTcbhq45/X6q/kuE5qKbNzoVSzKryEwT9opU7FDbI5\nnVXtQxNwYxqTDz20gWLFNoRXtBqOzVJNXtAsutYogKVormQPH3rTIApCDChfkmLn\n+WXTPbml/F+xhLPnAYq9rFc2jwKBgQDGtv68Aql4TKv8bHYrImkKOnPINl1dNVlU\nDZpUwv35euSBF04TFzdOJtpWzHhbLGI+Em6EXX7566WUI++Z2OW2jK/8bWLWMdzz\n2BNPA1VBfRJcmf4vLMLS5VVLdMdEWZqrqkgGNjzMqzo/tQN9NBc1PvcIZThfiva7\nwwNoCeFdjwKBgDVqKavZxmFboA0naU1mY18oZDR7SCLCSuPQD4D4EujYLj0nsYq/\nPuVrj1NTDEdtIIOlh5ynWjyNm8KA1Rnwa2AT+hGCCSpb7Km5t1c0IfCyzEV2S1Le\nTAUwRDeFmxGdMoSpcnbmWnWigfx/q6eD3fWBxYOOEv/hjIat7YqDbrfXAoGAeGYP\n2aJTRAxQeFTPFDt5ITVhSYGG+B6GzSKgy5KJh0sqf/y61V5PqA5qZATnN3ag37MT\nOyfa81oPrL5JQhHkvMJpLqyoIdd8ZFIbANioI1HAelLja3nXYSiKkXlj8snHqRM3\nKGxcUjW8yTTHtGiHVz+bNX7+tQThkcoKmlLCNYkCgYB6WLehQtFHvJ/ZXWbfEXBI\nQOrhfTLXfgRwe+zm/r9682DI9PoMcgs6hHUELIiJs33gSEK1YeQtvqWqSZUmqKYi\nKwJiAC3K50/x4fAnvq+vd1F514g08yIVXhGNA1x0kGY8wE/gpLI7v1qCRE160Gv3\n+y4uFuekLaE2u3kFhxL3yQ==\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-17T23:14:27.987 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout {"username": "admin", "password": "$2b$12$hjjReUaxALwshEJTR68Os.prrJPQjKOLLBYLzimadStgA65DiSLIy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1708211667, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-02-17T23:14:27.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:27 smithi005 bash[35193]: audit 2024-02-17T23:14:26.302330+0000 mgr.y (mgr.14140) 1 : audit [DBG] from='client.14153 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:14:27.995 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:27 smithi005 bash[35193]: audit 2024-02-17T23:14:27.319910+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:27.319257\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:27.319361\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-17T23:14:27.319458\", \"networks\": {}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:14:27.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:27 smithi005 bash[35193]: audit 2024-02-17T23:14:27.321801+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:27.319257\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:27.319361\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-17T23:14:27.319458\", \"networks\": {}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:14:27.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:27 smithi005 bash[35193]: audit 2024-02-17T23:14:27.322322+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:14:28.907 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:28 smithi005 bash[35193]: audit 2024-02-17T23:14:27.740906+0000 mgr.y (mgr.14140) 2 : audit [DBG] from='client.14155 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "password": "mq09sonix2", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:14:28.907 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:28 smithi005 bash[35193]: audit 2024-02-17T23:14:27.984313+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$hjjReUaxALwshEJTR68Os.prrJPQjKOLLBYLzimadStgA65DiSLIy\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1708211667, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]: dispatch 2024-02-17T23:14:28.907 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:28 smithi005 bash[35193]: audit 2024-02-17T23:14:27.985961+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/dashboard/accessdb_v2","val":"{\"users\": {\"admin\": {\"username\": \"admin\", \"password\": \"$2b$12$hjjReUaxALwshEJTR68Os.prrJPQjKOLLBYLzimadStgA65DiSLIy\", \"roles\": [\"administrator\"], \"name\": null, \"email\": null, \"lastUpdate\": 1708211667, \"enabled\": true, \"pwdExpirationDate\": null, \"pwdUpdateRequired\": true}}, \"roles\": {}, \"version\": 2}"}]': finished 2024-02-17T23:14:29.903 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Fetching dashboard port number... 2024-02-17T23:14:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:['/bin/podman', 'run', '--rm', '--net=host', '-e', 'CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0', '-e', 'NODE_NAME=smithi005', '-v', '/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z', '-v', '/tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z', '-v', '/tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z', '--entrypoint', '/usr/bin/ceph', 'docker.io/ceph/ceph:v15.2.0', 'config', 'get', 'mgr', 'mgr/dashboard/ssl_server_port'] 2024-02-17T23:14:29.904 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Running command: /bin/podman run --rm --net=host -e CONTAINER_IMAGE=docker.io/ceph/ceph:v15.2.0 -e NODE_NAME=smithi005 -v /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715:/var/log/ceph:z -v /tmp/ceph-tmpf50zpt6z:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpe4p8fztv:/etc/ceph/ceph.conf:z --entrypoint /usr/bin/ceph docker.io/ceph/ceph:v15.2.0 config get mgr mgr/dashboard/ssl_server_port 2024-02-17T23:14:30.921 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:30 smithi005 bash[35193]: cluster 2024-02-17T23:14:29.658210+0000 mon.a (mon.0) 101 : cluster [DBG] mgrmap e13: y(active, since 6s) 2024-02-17T23:14:31.067 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:/usr/bin/ceph:stdout 8443 2024-02-17T23:14:31.709 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Ceph Dashboard is now available at: 2024-02-17T23:14:31.709 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-02-17T23:14:31.709 INFO:teuthology.orchestra.run.smithi005.stderr: URL: https://smithi005.front.sepia.ceph.com:8443/ 2024-02-17T23:14:31.709 INFO:teuthology.orchestra.run.smithi005.stderr: User: admin 2024-02-17T23:14:31.709 INFO:teuthology.orchestra.run.smithi005.stderr: Password: mq09sonix2 2024-02-17T23:14:31.709 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:You can access the Ceph CLI with: 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Please consider enabling telemetry to help improve Ceph: 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr: ceph telemetry on 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr:For more information see: 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-02-17T23:14:31.710 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-02-17T23:14:31.711 INFO:teuthology.orchestra.run.smithi005.stderr:INFO:cephadm:Bootstrap complete. 2024-02-17T23:14:31.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Releasing lock 139758224550040 on /run/cephadm/1ffcdf7e-cdea-11ee-95ba-87774f69a715.lock 2024-02-17T23:14:31.711 INFO:teuthology.orchestra.run.smithi005.stderr:DEBUG:cephadm:Lock 139758224550040 released on /run/cephadm/1ffcdf7e-cdea-11ee-95ba-87774f69a715.lock 2024-02-17T23:14:31.738 INFO:tasks.cephadm:Fetching config... 2024-02-17T23:14:31.738 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-02-17T23:14:31.738 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-02-17T23:14:31.758 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-02-17T23:14:31.758 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-02-17T23:14:31.758 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-02-17T23:14:31.816 INFO:tasks.cephadm:Fetching mon keyring... 2024-02-17T23:14:31.817 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-02-17T23:14:31.817 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/mon.a/keyring of=/dev/stdout 2024-02-17T23:14:31.886 INFO:tasks.cephadm:Fetching pub ssh key... 2024-02-17T23:14:31.886 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-02-17T23:14:31.886 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-02-17T23:14:31.944 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-02-17T23:14:31.944 DEBUG:teuthology.orchestra.run.smithi005:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1yhadfSgzLKK2MgxogIW6gN5PdEcxOWZHttsb3cock0CaFSjpI/NTi8qFRzm22O87QVi0eDfuXAfY0AeCOgNPR8INUq1N3KqiOCr70E+pOhjSXdn3uHfywxBVdA8A0TPuz7zC9IPpovMy9AICxTf1g3UnQK/NRddCQ9wEumRxX7GuNQf0SXvuFWcWugwWFoXx5VBA8u5BW1JMwkF7xuWPsSnpt2tT1FsDkNd6CRrZ4Hj1rSQqCpmlTQonccr13gh+0zzvssFQtV68Z+vhCDM8b4Djtwt4TG/bbP42/vKVDnXfk7e0SYcPwrze5YQihTtWoi82ynLJLNt/xXdEUx9DCnxYRWPDg0oT0xWHTI4JfGuYchX43ChfCCUSj5++HizZzNDqhdZ2//kwY4aOmwp7ZDLkogDNFKte0MDl/Qlv1bn93gAshwl5uIBXEWBiw7D4JeGVttE+hym6JK5UOmDtmFIkGiSMLXOJg3HA3zRtnkj1/v+q/VQ7k/6WwjlQ/S8= ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-17T23:14:32.011 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:31 smithi005 bash[35193]: audit 2024-02-17T23:14:30.893924+0000 mon.a (mon.0) 102 : audit [DBG] from='client.? 172.21.15.5:0/489462113' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-02-17T23:14:32.011 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:31 smithi005 bash[35193]: audit 2024-02-17T23:14:30.958283+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:14:32.011 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:31 smithi005 bash[35193]: audit 2024-02-17T23:14:31.172258+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:27.319257\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:27.319361\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-17T23:14:27.319458\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:14:32.011 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:31 smithi005 bash[35193]: audit 2024-02-17T23:14:31.173964+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:27.319257\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:14:27.319361\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-17T23:14:27.319458\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:14:32.023 INFO:teuthology.orchestra.run.smithi005.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1yhadfSgzLKK2MgxogIW6gN5PdEcxOWZHttsb3cock0CaFSjpI/NTi8qFRzm22O87QVi0eDfuXAfY0AeCOgNPR8INUq1N3KqiOCr70E+pOhjSXdn3uHfywxBVdA8A0TPuz7zC9IPpovMy9AICxTf1g3UnQK/NRddCQ9wEumRxX7GuNQf0SXvuFWcWugwWFoXx5VBA8u5BW1JMwkF7xuWPsSnpt2tT1FsDkNd6CRrZ4Hj1rSQqCpmlTQonccr13gh+0zzvssFQtV68Z+vhCDM8b4Djtwt4TG/bbP42/vKVDnXfk7e0SYcPwrze5YQihTtWoi82ynLJLNt/xXdEUx9DCnxYRWPDg0oT0xWHTI4JfGuYchX43ChfCCUSj5++HizZzNDqhdZ2//kwY4aOmwp7ZDLkogDNFKte0MDl/Qlv1bn93gAshwl5uIBXEWBiw7D4JeGVttE+hym6JK5UOmDtmFIkGiSMLXOJg3HA3zRtnkj1/v+q/VQ7k/6WwjlQ/S8= ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:14:32.034 DEBUG:teuthology.orchestra.run.smithi080:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1yhadfSgzLKK2MgxogIW6gN5PdEcxOWZHttsb3cock0CaFSjpI/NTi8qFRzm22O87QVi0eDfuXAfY0AeCOgNPR8INUq1N3KqiOCr70E+pOhjSXdn3uHfywxBVdA8A0TPuz7zC9IPpovMy9AICxTf1g3UnQK/NRddCQ9wEumRxX7GuNQf0SXvuFWcWugwWFoXx5VBA8u5BW1JMwkF7xuWPsSnpt2tT1FsDkNd6CRrZ4Hj1rSQqCpmlTQonccr13gh+0zzvssFQtV68Z+vhCDM8b4Djtwt4TG/bbP42/vKVDnXfk7e0SYcPwrze5YQihTtWoi82ynLJLNt/xXdEUx9DCnxYRWPDg0oT0xWHTI4JfGuYchX43ChfCCUSj5++HizZzNDqhdZ2//kwY4aOmwp7ZDLkogDNFKte0MDl/Qlv1bn93gAshwl5uIBXEWBiw7D4JeGVttE+hym6JK5UOmDtmFIkGiSMLXOJg3HA3zRtnkj1/v+q/VQ7k/6WwjlQ/S8= ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-02-17T23:14:32.080 INFO:teuthology.orchestra.run.smithi080.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1yhadfSgzLKK2MgxogIW6gN5PdEcxOWZHttsb3cock0CaFSjpI/NTi8qFRzm22O87QVi0eDfuXAfY0AeCOgNPR8INUq1N3KqiOCr70E+pOhjSXdn3uHfywxBVdA8A0TPuz7zC9IPpovMy9AICxTf1g3UnQK/NRddCQ9wEumRxX7GuNQf0SXvuFWcWugwWFoXx5VBA8u5BW1JMwkF7xuWPsSnpt2tT1FsDkNd6CRrZ4Hj1rSQqCpmlTQonccr13gh+0zzvssFQtV68Z+vhCDM8b4Djtwt4TG/bbP42/vKVDnXfk7e0SYcPwrze5YQihTtWoi82ynLJLNt/xXdEUx9DCnxYRWPDg0oT0xWHTI4JfGuYchX43ChfCCUSj5++HizZzNDqhdZ2//kwY4aOmwp7ZDLkogDNFKte0MDl/Qlv1bn93gAshwl5uIBXEWBiw7D4JeGVttE+hym6JK5UOmDtmFIkGiSMLXOJg3HA3zRtnkj1/v+q/VQ7k/6WwjlQ/S8= ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:14:32.092 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi080 2024-02-17T23:14:32.093 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-17T23:14:32.093 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/etc/ceph/ceph.conf 2024-02-17T23:14:32.114 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-17T23:14:32.114 DEBUG:teuthology.orchestra.run.smithi080:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-17T23:14:32.175 INFO:tasks.cephadm:Adding host smithi080 to orchestrator... 2024-02-17T23:14:32.176 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch host add smithi080 2024-02-17T23:14:45.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:44 smithi005 bash[35193]: cluster 2024-02-17T23:14:43.649036+0000 mgr.y (mgr.14140) 3 : cluster [DBG] pgmap v3: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:14:47.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:46 smithi005 bash[35193]: cluster 2024-02-17T23:14:45.649312+0000 mgr.y (mgr.14140) 4 : cluster [DBG] pgmap v4: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:14:49.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:48 smithi005 bash[35193]: cluster 2024-02-17T23:14:47.649679+0000 mgr.y (mgr.14140) 5 : cluster [DBG] pgmap v5: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:14:51.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:50 smithi005 bash[35193]: cluster 2024-02-17T23:14:49.650014+0000 mgr.y (mgr.14140) 6 : cluster [DBG] pgmap v6: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:14:52.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:52 smithi005 bash[35193]: cluster 2024-02-17T23:14:51.650329+0000 mgr.y (mgr.14140) 7 : cluster [DBG] pgmap v7: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:14:52.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:14:52 smithi005 bash[35426]: Warning: Permanently added 'smithi080,172.21.15.80' (ECDSA) to the list of known hosts. 2024-02-17T23:14:53.518 INFO:teuthology.orchestra.run.smithi080.stdout:Added host 'smithi080' 2024-02-17T23:14:54.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:53 smithi005 bash[35193]: audit 2024-02-17T23:14:52.513378+0000 mgr.y (mgr.14140) 8 : audit [DBG] from='client.14159 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi080", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:14:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:53 smithi005 bash[35193]: audit 2024-02-17T23:14:52.987962+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"smithi005\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:14:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:53 smithi005 bash[35193]: audit 2024-02-17T23:14:52.989947+0000 mon.a (mon.0) 107 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"smithi005\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-17T23:14:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:53 smithi005 bash[35193]: audit 2024-02-17T23:14:53.185304+0000 mon.a (mon.0) 108 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:14:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:53 smithi005 bash[35193]: audit 2024-02-17T23:14:53.187000+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"networks\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:14:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:53 smithi005 bash[35193]: audit 2024-02-17T23:14:53.187664+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:14:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:53 smithi005 bash[35193]: audit 2024-02-17T23:14:53.360128+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-17T23:14:53.359817\", \"networks\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:14:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:53 smithi005 bash[35193]: audit 2024-02-17T23:14:53.361715+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {}, \"devices\": [], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-17T23:14:53.359817\", \"networks\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:14:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:53 smithi005 bash[35193]: audit 2024-02-17T23:14:53.362314+0000 mon.a (mon.0) 113 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:14:54.817 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch host ls --format=json 2024-02-17T23:14:55.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:54 smithi005 bash[35193]: cephadm 2024-02-17T23:14:52.990349+0000 mgr.y (mgr.14140) 9 : cephadm [INF] Added host smithi080 2024-02-17T23:14:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:54 smithi005 bash[35193]: cluster 2024-02-17T23:14:53.650600+0000 mgr.y (mgr.14140) 10 : cluster [DBG] pgmap v8: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:14:57.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:56 smithi005 bash[35193]: cluster 2024-02-17T23:14:55.650888+0000 mgr.y (mgr.14140) 11 : cluster [DBG] pgmap v9: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:14:57.287 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:14:57.287 INFO:teuthology.orchestra.run.smithi080.stdout:[{"addr": "smithi005", "hostname": "smithi005", "labels": [], "status": ""}, {"addr": "smithi080", "hostname": "smithi080", "labels": [], "status": ""}] 2024-02-17T23:14:58.601 INFO:tasks.cephadm:Setting crush tunables to default 2024-02-17T23:14:58.602 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd crush tunables default 2024-02-17T23:14:58.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:58 smithi005 bash[35193]: audit 2024-02-17T23:14:57.284528+0000 mgr.y (mgr.14140) 12 : audit [DBG] from='client.14161 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-17T23:14:58.988 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:58 smithi005 bash[35193]: cluster 2024-02-17T23:14:57.651161+0000 mgr.y (mgr.14140) 13 : cluster [DBG] pgmap v10: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:14:58.988 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:58 smithi005 bash[35193]: audit 2024-02-17T23:14:57.971184+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:14:58.988 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:58 smithi005 bash[35193]: audit 2024-02-17T23:14:58.151685+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-17T23:14:53.359817\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:14:58.988 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:14:58 smithi005 bash[35193]: audit 2024-02-17T23:14:58.153696+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {}, \"last_daemon_update\": \"2024-02-17T23:14:53.359817\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:00.667 INFO:teuthology.orchestra.run.smithi005.stderr:adjusted tunables profile to default 2024-02-17T23:15:01.006 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:00 smithi005 bash[35193]: cluster 2024-02-17T23:14:59.651533+0000 mgr.y (mgr.14140) 14 : cluster [DBG] pgmap v11: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:01.006 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:00 smithi005 bash[35193]: audit 2024-02-17T23:15:00.468563+0000 mon.a (mon.0) 117 : audit [INF] from='client.? 172.21.15.5:0/2678818310' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-02-17T23:15:01.325 INFO:tasks.cephadm:Adding mon.c on smithi005 2024-02-17T23:15:01.325 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch daemon add mon 'smithi005:[v2:172.21.15.5:3301,v1:172.21.15.5:6790]=c' 2024-02-17T23:15:01.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:01 smithi005 bash[35193]: audit 2024-02-17T23:15:00.663700+0000 mon.a (mon.0) 118 : audit [INF] from='client.? 172.21.15.5:0/2678818310' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-02-17T23:15:01.932 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:01 smithi005 bash[35193]: cluster 2024-02-17T23:15:00.663733+0000 mon.a (mon.0) 119 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-17T23:15:02.818 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:02 smithi005 bash[35193]: cluster 2024-02-17T23:15:01.651887+0000 mgr.y (mgr.14140) 15 : cluster [DBG] pgmap v13: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:03.900 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:03 smithi005 bash[35193]: audit 2024-02-17T23:15:03.216063+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:15:03.901 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:03 smithi005 bash[35193]: audit 2024-02-17T23:15:03.216673+0000 mon.a (mon.0) 121 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:03.901 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:03 smithi005 bash[35193]: audit 2024-02-17T23:15:03.217308+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2024-02-17T23:15:04.950 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:04 smithi005 bash[35193]: audit 2024-02-17T23:15:03.214470+0000 mgr.y (mgr.14140) 16 : audit [DBG] from='client.14165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi005:[v2:172.21.15.5:3301,v1:172.21.15.5:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:15:04.951 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:04 smithi005 bash[35193]: cephadm 2024-02-17T23:15:03.217116+0000 mgr.y (mgr.14140) 17 : cephadm [INF] Deploying daemon mon.c on smithi005 2024-02-17T23:15:04.951 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:04 smithi005 bash[35193]: cluster 2024-02-17T23:15:03.652300+0000 mgr.y (mgr.14140) 18 : cluster [DBG] pgmap v14: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:07.222 INFO:teuthology.orchestra.run.smithi005.stdout:Deployed mon.c on host 'smithi005' 2024-02-17T23:15:08.066 DEBUG:teuthology.orchestra.run.smithi005:mon.c> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.c.service 2024-02-17T23:15:08.068 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-02-17T23:15:08.068 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-17T23:15:08.101 INFO:journalctl@ceph.mon.c.smithi005.stdout:-- Logs begin at Sat 2024-02-17 23:05:20 UTC. -- 2024-02-17T23:15:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: cluster 2024-02-17T23:15:06.655713+0000 mon.a (mon.0) 126 : cluster [INF] mon.a calling monitor election 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: cluster 2024-02-17T23:15:07.652769+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: audit 2024-02-17T23:15:08.153192+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152351\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}}, \"last_daemon_update\": \"2024-02-17T23:15:08.152459\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: cluster 2024-02-17T23:15:08.654287+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: cluster 2024-02-17T23:15:09.653013+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: cluster 2024-02-17T23:15:11.681871+0000 mon.a (mon.0) 128 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: cluster 2024-02-17T23:15:11.684628+0000 mon.a (mon.0) 129 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: cluster 2024-02-17T23:15:11.684700+0000 mon.a (mon.0) 130 : cluster [DBG] fsmap 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: cluster 2024-02-17T23:15:11.684730+0000 mon.a (mon.0) 131 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: cluster 2024-02-17T23:15:11.684972+0000 mon.a (mon.0) 132 : cluster [DBG] mgrmap e13: y(active, since 48s) 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: audit 2024-02-17T23:15:11.685863+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152351\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}}, \"last_daemon_update\": \"2024-02-17T23:15:08.152459\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: cluster 2024-02-17T23:15:11.688364+0000 mon.a (mon.0) 134 : cluster [INF] overall HEALTH_OK 2024-02-17T23:15:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[35193]: audit 2024-02-17T23:15:11.690220+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152351\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}}, \"last_daemon_update\": \"2024-02-17T23:15:08.152459\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:15:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: cluster 2024-02-17T23:15:06.655713+0000 mon.a (mon.0) 126 : cluster [INF] mon.a calling monitor election 2024-02-17T23:15:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: cluster 2024-02-17T23:15:07.652769+0000 mgr.y (mgr.14140) 20 : cluster [DBG] pgmap v16: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: audit 2024-02-17T23:15:08.153192+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152351\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}}, \"last_daemon_update\": \"2024-02-17T23:15:08.152459\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:15:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: cluster 2024-02-17T23:15:08.654287+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-17T23:15:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: cluster 2024-02-17T23:15:09.653013+0000 mgr.y (mgr.14140) 21 : cluster [DBG] pgmap v17: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: cluster 2024-02-17T23:15:11.681871+0000 mon.a (mon.0) 128 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-17T23:15:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: cluster 2024-02-17T23:15:11.684628+0000 mon.a (mon.0) 129 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} 2024-02-17T23:15:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: cluster 2024-02-17T23:15:11.684700+0000 mon.a (mon.0) 130 : cluster [DBG] fsmap 2024-02-17T23:15:12.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: cluster 2024-02-17T23:15:11.684730+0000 mon.a (mon.0) 131 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-17T23:15:12.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: cluster 2024-02-17T23:15:11.684972+0000 mon.a (mon.0) 132 : cluster [DBG] mgrmap e13: y(active, since 48s) 2024-02-17T23:15:12.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: audit 2024-02-17T23:15:11.685863+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152351\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}}, \"last_daemon_update\": \"2024-02-17T23:15:08.152459\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:15:12.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: cluster 2024-02-17T23:15:11.688364+0000 mon.a (mon.0) 134 : cluster [INF] overall HEALTH_OK 2024-02-17T23:15:12.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:11 smithi005 bash[38535]: audit 2024-02-17T23:15:11.690220+0000 mon.a (mon.0) 135 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152351\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}}, \"last_daemon_update\": \"2024-02-17T23:15:08.152459\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:15:12.555 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:15:12.555 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":2,"fsid":"1ffcdf7e-cdea-11ee-95ba-87774f69a715","modified":"2024-02-17T23:15:06.653673Z","created":"2024-02-17T23:13:40.033984Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0}],"quorum":[0,1]} 2024-02-17T23:15:12.556 INFO:teuthology.orchestra.run.smithi005.stderr:dumped monmap epoch 2 2024-02-17T23:15:12.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:12 smithi005 bash[35193]: cluster 2024-02-17T23:15:11.653248+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:12.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:12 smithi005 bash[35193]: audit 2024-02-17T23:15:12.553207+0000 mon.a (mon.0) 136 : audit [DBG] from='client.? 172.21.15.5:0/1641909184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-17T23:15:12.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:12 smithi005 bash[38535]: cluster 2024-02-17T23:15:11.653248+0000 mgr.y (mgr.14140) 22 : cluster [DBG] pgmap v18: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:12.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:12 smithi005 bash[38535]: audit 2024-02-17T23:15:12.553207+0000 mon.a (mon.0) 136 : audit [DBG] from='client.? 172.21.15.5:0/1641909184' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-17T23:15:13.252 INFO:tasks.cephadm:Adding mon.b on smithi080 2024-02-17T23:15:13.252 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch daemon add mon smithi080:172.21.15.80=b 2024-02-17T23:15:15.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:14 smithi005 bash[35193]: cluster 2024-02-17T23:15:13.653469+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:15.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:14 smithi005 bash[38535]: cluster 2024-02-17T23:15:13.653469+0000 mgr.y (mgr.14140) 23 : cluster [DBG] pgmap v19: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:15 smithi005 bash[35193]: audit 2024-02-17T23:15:15.154589+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:15:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:15 smithi005 bash[35193]: audit 2024-02-17T23:15:15.155352+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:15 smithi005 bash[35193]: audit 2024-02-17T23:15:15.156175+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-17T23:15:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:15 smithi005 bash[38535]: audit 2024-02-17T23:15:15.154589+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:15:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:15 smithi005 bash[38535]: audit 2024-02-17T23:15:15.155352+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:15 smithi005 bash[38535]: audit 2024-02-17T23:15:15.156175+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2024-02-17T23:15:17.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:16 smithi005 bash[35193]: audit 2024-02-17T23:15:15.153197+0000 mgr.y (mgr.14140) 24 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi080:172.21.15.80=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:15:17.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:16 smithi005 bash[35193]: cephadm 2024-02-17T23:15:15.155909+0000 mgr.y (mgr.14140) 25 : cephadm [INF] Deploying daemon mon.b on smithi080 2024-02-17T23:15:17.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:16 smithi005 bash[35193]: cluster 2024-02-17T23:15:15.653734+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:17.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:16 smithi005 bash[38535]: audit 2024-02-17T23:15:15.153197+0000 mgr.y (mgr.14140) 24 : audit [DBG] from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi080:172.21.15.80=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:15:17.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:16 smithi005 bash[38535]: cephadm 2024-02-17T23:15:15.155909+0000 mgr.y (mgr.14140) 25 : cephadm [INF] Deploying daemon mon.b on smithi080 2024-02-17T23:15:17.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:16 smithi005 bash[38535]: cluster 2024-02-17T23:15:15.653734+0000 mgr.y (mgr.14140) 26 : cluster [DBG] pgmap v20: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:19.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:18 smithi005 bash[35193]: cluster 2024-02-17T23:15:17.653990+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:19.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:18 smithi005 bash[38535]: cluster 2024-02-17T23:15:17.653990+0000 mgr.y (mgr.14140) 27 : cluster [DBG] pgmap v21: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:21.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:20 smithi005 bash[35193]: cluster 2024-02-17T23:15:19.654249+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:21.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:20 smithi005 bash[38535]: cluster 2024-02-17T23:15:19.654249+0000 mgr.y (mgr.14140) 28 : cluster [DBG] pgmap v22: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:23.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:22 smithi005 bash[35193]: cluster 2024-02-17T23:15:21.654517+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:23.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:22 smithi005 bash[38535]: cluster 2024-02-17T23:15:21.654517+0000 mgr.y (mgr.14140) 29 : cluster [DBG] pgmap v23: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:25.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:24 smithi005 bash[35193]: cluster 2024-02-17T23:15:23.654821+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:25.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:24 smithi005 bash[38535]: cluster 2024-02-17T23:15:23.654821+0000 mgr.y (mgr.14140) 30 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:25 smithi005 bash[35193]: cluster 2024-02-17T23:15:24.631881+0000 mon.a (mon.0) 140 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-17T23:15:26.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:25 smithi005 bash[38535]: cluster 2024-02-17T23:15:24.631881+0000 mon.a (mon.0) 140 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-17T23:15:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:26 smithi005 bash[35193]: cluster 2024-02-17T23:15:25.655136+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:27.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:26 smithi005 bash[38535]: cluster 2024-02-17T23:15:25.655136+0000 mgr.y (mgr.14140) 31 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:27.175 INFO:teuthology.orchestra.run.smithi080.stdout:Deployed mon.b on host 'smithi080' 2024-02-17T23:15:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:27 smithi005 bash[35193]: audit 2024-02-17T23:15:26.686335+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:27 smithi005 bash[35193]: audit 2024-02-17T23:15:26.686747+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:15:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:27 smithi005 bash[35193]: audit 2024-02-17T23:15:26.688942+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:28.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:27 smithi005 bash[38535]: audit 2024-02-17T23:15:26.686335+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:28.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:27 smithi005 bash[38535]: audit 2024-02-17T23:15:26.686747+0000 mon.a (mon.0) 142 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:15:28.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:27 smithi005 bash[38535]: audit 2024-02-17T23:15:26.688942+0000 mon.a (mon.0) 143 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:28 smithi005 bash[35193]: cluster 2024-02-17T23:15:27.655431+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:29.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:28 smithi005 bash[38535]: cluster 2024-02-17T23:15:27.655431+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:29.312 DEBUG:teuthology.orchestra.run.smithi080:mon.b> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.b.service 2024-02-17T23:15:29.315 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-02-17T23:15:29.315 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph mon dump -f json 2024-02-17T23:15:29.348 INFO:journalctl@ceph.mon.b.smithi080.stdout:-- Logs begin at Sat 2024-02-17 23:05:17 UTC. -- 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.416+0000 7fc6b366e6c0 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.416+0000 7fc6b366e6c0 0 ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc), process ceph-mon, pid 1 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.417+0000 7fc6b366e6c0 0 pidfile_write: ignore empty --pid-file 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.421+0000 7fc6b366e6c0 0 load: jerasure load: lrc load: isa 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.421+0000 7fc6b366e6c0 0 set rocksdb option compression = kNoCompression 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.421+0000 7fc6b366e6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.421+0000 7fc6b366e6c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.421+0000 7fc6b366e6c0 0 set rocksdb option compression = kNoCompression 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.421+0000 7fc6b366e6c0 0 set rocksdb option level_compaction_dynamic_level_bytes = true 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.421+0000 7fc6b366e6c0 0 set rocksdb option write_buffer_size = 33554432 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.421+0000 7fc6b366e6c0 1 rocksdb: do_open column families: [default] 2024-02-17T23:15:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: RocksDB version: 6.1.2 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Compile date Mar 23 2020 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: DB SUMMARY 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: CURRENT file: CURRENT 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: IDENTITY file: IDENTITY 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 610 ; 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.error_if_exists: 0 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.create_if_missing: 0 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.paranoid_checks: 1 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.env: 0x56213c6811a0 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.info_log: 0x56213d4269c0 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.statistics: (nil) 2024-02-17T23:15:29.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.use_fsync: 0 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_log_file_size: 0 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.allow_fallocate: 1 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.use_direct_reads: 0 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.create_missing_column_families: 0 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.db_log_dir: 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-17T23:15:29.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_subcompactions: 1 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_background_flushes: -1 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.advise_random_on_open: 1 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.write_buffer_manager: 0x56213dfbea80 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.rate_limiter: (nil) 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-17T23:15:29.644 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.row_cache: None 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.wal_filter: None 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.preserve_deletes: 0 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.two_write_queues: 0 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.manual_wal_flush: 0 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.atomic_flush: 0 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-17T23:15:29.645 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_background_jobs: 2 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_background_compactions: -1 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_total_wal_size: 0 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_open_files: -1 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.bytes_per_sync: 0 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Compression algorithms supported: 2024-02-17T23:15:29.646 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: kZSTD supported: 0 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: kXpressCompression supported: 0 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: kLZ4Compression supported: 1 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: kBZip2Compression supported: 0 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: kZlibCompression supported: 1 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: kSnappyCompression supported: 1 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: [db/version_set.cc:3543] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: [db/column_family.cc:477] --------------- Options for column family [default]: 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.merge_operator: 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_filter: None 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_filter_factory: None 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-17T23:15:29.647 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56213d342130) 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: cache_index_and_filter_blocks: 1 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: cache_index_and_filter_blocks_with_high_priority: 1 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: pin_top_level_index_and_filter: 1 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: index_type: 0 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: data_block_index_type: 0 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: data_block_hash_table_util_ratio: 0.750000 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: hash_index_allow_collision: 1 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: checksum: 1 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: no_block_cache: 0 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: block_cache: 0x56213d37c610 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: block_cache_name: BinnedLRUCache 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: block_cache_options: 2024-02-17T23:15:29.648 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: capacity : 536870912 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: num_shard_bits : 4 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: strict_capacity_limit : 0 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: high_pri_pool_ratio: 0.000 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: block_cache_compressed: (nil) 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: persistent_cache: (nil) 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: block_size: 4096 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: block_size_deviation: 10 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: block_restart_interval: 16 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: index_block_restart_interval: 1 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: metadata_block_size: 4096 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: partition_filters: 0 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: use_delta_encoding: 1 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: whole_key_filtering: 1 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: verify_compression: 0 2024-02-17T23:15:29.649 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: read_amp_bytes_per_bit: 0 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: format_version: 2 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: enable_index_compression: 1 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: block_align: 0 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compression: NoCompression 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.num_levels: 7 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-17T23:15:29.650 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compression_opts.level: 32767 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compression_opts.enabled: false 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-17T23:15:29.651 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.arena_block_size: 4194304 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-17T23:15:29.652 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.table_properties_collectors: 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.inplace_update_support: 0 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-17T23:15:29.653 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.bloom_locality: 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.max_successive_merges: 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.force_consistency_checks: 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.422+0000 7fc6b366e6c0 4 rocksdb: Options.ttl: 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.423+0000 7fc6b366e6c0 4 rocksdb: [db/version_set.cc:3757] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.423+0000 7fc6b366e6c0 4 rocksdb: [db/version_set.cc:3766] Column family [default] (ID 0), log number is 0 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.423+0000 7fc6b366e6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708211729423840, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.423+0000 7fc6b366e6c0 4 rocksdb: [db/db_impl_open.cc:583] Recovering log #3 mode 2 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.423+0000 7fc6b366e6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708211729424284, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1524, "table_properties": {"data_size": 622, "index_size": 28, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 500, "raw_average_value_size": 100, "num_data_blocks": 1, "num_entries": 5, "filter_policy_name": "rocksdb.BuiltinBloomFilter"}} 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.423+0000 7fc6b366e6c0 4 rocksdb: [db/version_set.cc:3036] Creating manifest 5 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.423+0000 7fc6b366e6c0 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708211729424612, "job": 1, "event": "recovery_finished"} 2024-02-17T23:15:29.654 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.424+0000 7fc6b366e6c0 4 rocksdb: DB pointer 0x56213d417200 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.424+0000 7fc69a7bb700 4 rocksdb: [db/db_impl.cc:777] ------- DUMPING STATS ------- 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.424+0000 7fc69a7bb700 4 rocksdb: [db/db_impl.cc:778] 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ** DB Stats ** 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ** Compaction Stats [default] ** 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2024-02-17T23:15:29.655 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2024-02-17T23:15:29.656 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ** Compaction Stats [default] ** 2024-02-17T23:15:29.656 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:15:29.656 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:15:29.656 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2024-02-17T23:15:29.656 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:15:29.656 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ** Compaction Stats [default] ** 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: L0 1/0 1.49 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Sum 1/0 1.49 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ** Compaction Stats [default] ** 2024-02-17T23:15:29.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.7 0.00 0.00 1 0.000 0 0 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Flush(GB): cumulative 0.000, interval 0.000 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.424+0000 7fc6b366e6c0 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.425+0000 7fc6b366e6c0 0 using public_addr v2:172.21.15.80:0/0 -> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.425+0000 7fc6b366e6c0 0 starting mon.b rank -1 at public addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] at bind addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:15:29.658 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.426+0000 7fc6b366e6c0 1 mon.b@-1(???) e0 preinit fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.450+0000 7fc69cfc0700 0 mon.b@-1(synchronizing).mds e1 new map 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.450+0000 7fc69cfc0700 0 mon.b@-1(synchronizing).mds e1 print_map 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: e1 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: legacy client fscid: -1 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: No filesystems configured 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.450+0000 7fc69cfc0700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.450+0000 7fc69cfc0700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.450+0000 7fc69cfc0700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.450+0000 7fc69cfc0700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.450+0000 7fc69cfc0700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.450+0000 7fc69cfc0700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.450+0000 7fc69cfc0700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-02-17T23:15:29.659 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.450+0000 7fc69cfc0700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.452+0000 7fc69cfc0700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.453+0000 7fc69cfc0700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.453+0000 7fc69cfc0700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.453+0000 7fc69cfc0700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: cluster 2024-02-17T23:15:27.655431+0000 mgr.y (mgr.14140) 32 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.453+0000 7fc69cfc0700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta expand map: {default=false} 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta from 'false' to 'false' 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta expanded map: {default=false} 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta expand map: {default=info} 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta from 'info' to 'info' 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta expanded map: {default=info} 2024-02-17T23:15:29.660 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta expand map: {default=daemon} 2024-02-17T23:15:29.661 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta from 'daemon' to 'daemon' 2024-02-17T23:15:29.661 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta expanded map: {default=daemon} 2024-02-17T23:15:29.661 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta expand map: {default=debug} 2024-02-17T23:15:29.661 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta from 'debug' to 'debug' 2024-02-17T23:15:29.661 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:29 smithi080 bash[35203]: debug 2024-02-17T23:15:29.454+0000 7fc69cfc0700 20 expand_channel_meta expanded map: {default=debug} 2024-02-17T23:15:34.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:29.461014+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2024-02-17T23:15:34.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:29.461022+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-17T23:15:34.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:29.655691+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:34.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:31.655894+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:34.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: audit 2024-02-17T23:15:31.820179+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}}, \"last_daemon_update\": \"2024-02-17T23:15:31.819650\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:34.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:33.656149+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:34.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:34.462157+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-17T23:15:34.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:29.461014+0000 mon.a (mon.0) 144 : cluster [INF] mon.a calling monitor election 2024-02-17T23:15:34.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:29.461022+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2024-02-17T23:15:34.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:29.655691+0000 mgr.y (mgr.14140) 33 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:34.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:31.655894+0000 mgr.y (mgr.14140) 34 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:34.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: audit 2024-02-17T23:15:31.820179+0000 mon.a (mon.0) 145 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}}, \"last_daemon_update\": \"2024-02-17T23:15:31.819650\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:34.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:33.656149+0000 mgr.y (mgr.14140) 35 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:34.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:34.462157+0000 mon.a (mon.0) 146 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:34.464646+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:34.464689+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:34.464713+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:34.464911+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 70s) 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:34.465098+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: audit 2024-02-17T23:15:34.465850+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}}, \"last_daemon_update\": \"2024-02-17T23:15:31.819650\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: cluster 2024-02-17T23:15:34.469003+0000 mon.a (mon.0) 153 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum a,c; Reduced data availability: 1 pg inactive 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[35193]: audit 2024-02-17T23:15:34.471072+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}}, \"last_daemon_update\": \"2024-02-17T23:15:31.819650\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:34.464646+0000 mon.a (mon.0) 147 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:34.464689+0000 mon.a (mon.0) 148 : cluster [DBG] fsmap 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:34.464713+0000 mon.a (mon.0) 149 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-17T23:15:34.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:34.464911+0000 mon.a (mon.0) 150 : cluster [DBG] mgrmap e13: y(active, since 70s) 2024-02-17T23:15:34.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:34.465098+0000 mon.a (mon.0) 151 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-17T23:15:34.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: audit 2024-02-17T23:15:34.465850+0000 mon.a (mon.0) 152 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}}, \"last_daemon_update\": \"2024-02-17T23:15:31.819650\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:34.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: cluster 2024-02-17T23:15:34.469003+0000 mon.a (mon.0) 153 : cluster [WRN] overall HEALTH_WARN 1/3 mons down, quorum a,c; Reduced data availability: 1 pg inactive 2024-02-17T23:15:34.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:34 smithi005 bash[38535]: audit 2024-02-17T23:15:34.471072+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}}, \"last_daemon_update\": \"2024-02-17T23:15:31.819650\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:35.584 INFO:teuthology.orchestra.run.smithi080.stdout: 2024-02-17T23:15:35.584 INFO:teuthology.orchestra.run.smithi080.stdout:{"epoch":3,"fsid":"1ffcdf7e-cdea-11ee-95ba-87774f69a715","modified":"2024-02-17T23:15:29.457468Z","created":"2024-02-17T23:13:40.033984Z","min_mon_release":15,"min_mon_release_name":"octopus","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3300","nonce":0},{"type":"v1","addr":"172.21.15.5:6789","nonce":0}]},"addr":"172.21.15.5:6789/0","public_addr":"172.21.15.5:6789/0","priority":0,"weight":0},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:3301","nonce":0},{"type":"v1","addr":"172.21.15.5:6790","nonce":0}]},"addr":"172.21.15.5:6790/0","public_addr":"172.21.15.5:6790/0","priority":0,"weight":0},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:3300","nonce":0},{"type":"v1","addr":"172.21.15.80:6789","nonce":0}]},"addr":"172.21.15.80:6789/0","public_addr":"172.21.15.80:6789/0","priority":0,"weight":0}],"quorum":[0,1]} 2024-02-17T23:15:35.585 INFO:teuthology.orchestra.run.smithi080.stderr:dumped monmap epoch 3 2024-02-17T23:15:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:35 smithi005 bash[35193]: audit 2024-02-17T23:15:35.583097+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.15.80:0/2243448193' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-17T23:15:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:35 smithi005 bash[38535]: audit 2024-02-17T23:15:35.583097+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.15.80:0/2243448193' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-17T23:15:36.257 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-02-17T23:15:36.257 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph config generate-minimal-conf 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: audit 2024-02-17T23:15:35.583097+0000 mon.a (mon.0) 155 : audit [DBG] from='client.? 172.21.15.80:0/2243448193' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:31.458427+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:36.472380+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:36.472900+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:36.473046+0000 mon.a (mon.0) 156 : cluster [INF] mon.a calling monitor election 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:36.498654+0000 mon.a (mon.0) 157 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:36.506901+0000 mon.a (mon.0) 158 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:36.506943+0000 mon.a (mon.0) 159 : cluster [DBG] fsmap 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:36.506968+0000 mon.a (mon.0) 160 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:36.507131+0000 mon.a (mon.0) 161 : cluster [DBG] mgrmap e13: y(active, since 72s) 2024-02-17T23:15:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:36.507259+0000 mon.a (mon.0) 162 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-17T23:15:36.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:36 smithi080 bash[35203]: cluster 2024-02-17T23:15:36.512862+0000 mon.a (mon.0) 163 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-17T23:15:36.898 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:31.458427+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-17T23:15:36.898 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:36.472380+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-17T23:15:36.898 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:36.472900+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-02-17T23:15:36.898 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:36.473046+0000 mon.a (mon.0) 156 : cluster [INF] mon.a calling monitor election 2024-02-17T23:15:36.898 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:36.498654+0000 mon.a (mon.0) 157 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:15:36.898 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:36.506901+0000 mon.a (mon.0) 158 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:36.506943+0000 mon.a (mon.0) 159 : cluster [DBG] fsmap 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:36.506968+0000 mon.a (mon.0) 160 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:36.507131+0000 mon.a (mon.0) 161 : cluster [DBG] mgrmap e13: y(active, since 72s) 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:36.507259+0000 mon.a (mon.0) 162 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[35193]: cluster 2024-02-17T23:15:36.512862+0000 mon.a (mon.0) 163 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:31.458427+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:36.472380+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:36.472900+0000 mon.c (mon.1) 3 : cluster [INF] mon.c calling monitor election 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:36.473046+0000 mon.a (mon.0) 156 : cluster [INF] mon.a calling monitor election 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:36.498654+0000 mon.a (mon.0) 157 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:36.506901+0000 mon.a (mon.0) 158 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:36.506943+0000 mon.a (mon.0) 159 : cluster [DBG] fsmap 2024-02-17T23:15:36.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:36.506968+0000 mon.a (mon.0) 160 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2024-02-17T23:15:36.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:36.507131+0000 mon.a (mon.0) 161 : cluster [DBG] mgrmap e13: y(active, since 72s) 2024-02-17T23:15:36.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:36.507259+0000 mon.a (mon.0) 162 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-17T23:15:36.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:36 smithi005 bash[38535]: cluster 2024-02-17T23:15:36.512862+0000 mon.a (mon.0) 163 : cluster [WRN] overall HEALTH_WARN Reduced data availability: 1 pg inactive 2024-02-17T23:15:38.260 INFO:teuthology.orchestra.run.smithi005.stdout:# minimal ceph.conf for 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:15:38.260 INFO:teuthology.orchestra.run.smithi005.stdout:[global] 2024-02-17T23:15:38.260 INFO:teuthology.orchestra.run.smithi005.stdout: fsid = 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:15:38.261 INFO:teuthology.orchestra.run.smithi005.stdout: mon_host = [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] 2024-02-17T23:15:39.047 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:38 smithi005 bash[38535]: cluster 2024-02-17T23:15:37.656665+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:39.047 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:38 smithi005 bash[38535]: audit 2024-02-17T23:15:38.259052+0000 mon.a (mon.0) 164 : audit [DBG] from='client.? 172.21.15.5:0/1674063726' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:39.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:38 smithi005 bash[35193]: cluster 2024-02-17T23:15:37.656665+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:39.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:38 smithi005 bash[35193]: audit 2024-02-17T23:15:38.259052+0000 mon.a (mon.0) 164 : audit [DBG] from='client.? 172.21.15.5:0/1674063726' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:39.059 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-02-17T23:15:39.059 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-02-17T23:15:39.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.conf 2024-02-17T23:15:39.094 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-02-17T23:15:39.094 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-17T23:15:39.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:38 smithi080 bash[35203]: cluster 2024-02-17T23:15:37.656665+0000 mgr.y (mgr.14140) 37 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:39.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:38 smithi080 bash[35203]: audit 2024-02-17T23:15:38.259052+0000 mon.a (mon.0) 164 : audit [DBG] from='client.? 172.21.15.5:0/1674063726' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:39.165 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-17T23:15:39.165 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.conf 2024-02-17T23:15:39.203 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-17T23:15:39.203 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-02-17T23:15:39.276 INFO:tasks.cephadm:Adding mgr.y on smithi005 2024-02-17T23:15:39.276 INFO:tasks.cephadm:Adding mgr.x on smithi080 2024-02-17T23:15:39.276 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch apply mgr '2;smithi005=y;smithi080=x' 2024-02-17T23:15:40.568 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:40 smithi080 bash[35203]: cluster 2024-02-17T23:15:39.656986+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:40.875 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:40 smithi005 bash[35193]: cluster 2024-02-17T23:15:39.656986+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:40.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:40 smithi005 bash[38535]: cluster 2024-02-17T23:15:39.656986+0000 mgr.y (mgr.14140) 38 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:41.243 INFO:teuthology.orchestra.run.smithi080.stdout:Scheduled mgr update... 2024-02-17T23:15:41.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:41 smithi080 bash[35203]: audit 2024-02-17T23:15:41.236460+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-17T23:15:41.236025\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-02-17T23:15:41.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:41 smithi080 bash[35203]: audit 2024-02-17T23:15:41.240022+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-17T23:15:41.236025\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-02-17T23:15:41.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:41 smithi080 bash[35203]: audit 2024-02-17T23:15:41.241512+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:15:41.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:41 smithi080 bash[35203]: audit 2024-02-17T23:15:41.244756+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-17T23:15:41.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:41 smithi080 bash[35203]: audit 2024-02-17T23:15:41.245674+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:41.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:41 smithi080 bash[35203]: audit 2024-02-17T23:15:41.246740+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-17T23:15:41.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[35193]: audit 2024-02-17T23:15:41.236460+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-17T23:15:41.236025\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-02-17T23:15:41.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[35193]: audit 2024-02-17T23:15:41.240022+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-17T23:15:41.236025\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-02-17T23:15:41.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[35193]: audit 2024-02-17T23:15:41.241512+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:15:41.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[35193]: audit 2024-02-17T23:15:41.244756+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-17T23:15:41.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[35193]: audit 2024-02-17T23:15:41.245674+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:41.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[35193]: audit 2024-02-17T23:15:41.246740+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-17T23:15:41.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[38535]: audit 2024-02-17T23:15:41.236460+0000 mon.a (mon.0) 165 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-17T23:15:41.236025\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]: dispatch 2024-02-17T23:15:41.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[38535]: audit 2024-02-17T23:15:41.240022+0000 mon.a (mon.0) 166 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.mgr","val":"{\"created\": \"2024-02-17T23:15:41.236025\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"y\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"x\", \"network\": \"\"}]}, \"service_type\": \"mgr\"}}"}]': finished 2024-02-17T23:15:41.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[38535]: audit 2024-02-17T23:15:41.241512+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:15:41.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[38535]: audit 2024-02-17T23:15:41.244756+0000 mon.a (mon.0) 168 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-02-17T23:15:41.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[38535]: audit 2024-02-17T23:15:41.245674+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:41.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:41 smithi005 bash[38535]: audit 2024-02-17T23:15:41.246740+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-17T23:15:42.094 DEBUG:teuthology.orchestra.run.smithi080:mgr.x> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.x.service 2024-02-17T23:15:42.097 INFO:tasks.cephadm:Deploying OSDs... 2024-02-17T23:15:42.097 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-02-17T23:15:42.097 DEBUG:teuthology.orchestra.run.smithi005:> dd if=/scratch_devs of=/dev/stdout 2024-02-17T23:15:42.120 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-17T23:15:42.120 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_1 2024-02-17T23:15:42.126 INFO:journalctl@ceph.mgr.x.smithi080.stdout:-- Logs begin at Sat 2024-02-17 23:05:17 UTC. -- 2024-02-17T23:15:42.183 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-17T23:15:42.183 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T23:15:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 163559 Links: 1 2024-02-17T23:15:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T23:15:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T23:15:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-02-17 23:15:06.139470509 +0000 2024-02-17T23:15:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-02-17 23:11:35.749404563 +0000 2024-02-17T23:15:42.183 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-02-17 23:11:35.749404563 +0000 2024-02-17T23:15:42.183 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-02-17T23:15:42.184 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-17T23:15:42.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-02-17T23:15:42.254 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-02-17T23:15:42.254 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000115176 s, 4.4 MB/s 2024-02-17T23:15:42.255 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-17T23:15:42.316 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_2 2024-02-17T23:15:42.377 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-17T23:15:42.377 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T23:15:42.377 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 167390 Links: 1 2024-02-17T23:15:42.377 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T23:15:42.377 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T23:15:42.378 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-02-17 23:15:06.139470509 +0000 2024-02-17T23:15:42.378 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-02-17 23:11:36.090397712 +0000 2024-02-17T23:15:42.378 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-02-17 23:11:36.090397712 +0000 2024-02-17T23:15:42.378 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-02-17T23:15:42.378 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-17T23:15:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-02-17T23:15:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-02-17T23:15:42.449 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000113123 s, 4.5 MB/s 2024-02-17T23:15:42.450 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-17T23:15:42.511 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_3 2024-02-17T23:15:42.571 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-17T23:15:42.571 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T23:15:42.571 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 170028 Links: 1 2024-02-17T23:15:42.571 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T23:15:42.571 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T23:15:42.571 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-02-17 23:15:06.139470509 +0000 2024-02-17T23:15:42.571 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-02-17 23:11:36.430390881 +0000 2024-02-17T23:15:42.571 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-02-17 23:11:36.430390881 +0000 2024-02-17T23:15:42.571 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-02-17T23:15:42.572 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-17T23:15:42.625 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:42 smithi005 bash[35193]: audit 2024-02-17T23:15:41.235354+0000 mgr.y (mgr.14140) 39 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi005=y;smithi080=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:15:42.625 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:42 smithi005 bash[35193]: cephadm 2024-02-17T23:15:41.236004+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Saving service mgr spec with placement count:2 smithi005=y,smithi080=x 2024-02-17T23:15:42.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:42 smithi005 bash[35193]: cephadm 2024-02-17T23:15:41.246286+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Deploying daemon mgr.x on smithi080 2024-02-17T23:15:42.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:42 smithi005 bash[35193]: cluster 2024-02-17T23:15:41.657228+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:42.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:42 smithi005 bash[38535]: audit 2024-02-17T23:15:41.235354+0000 mgr.y (mgr.14140) 39 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi005=y;smithi080=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:15:42.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:42 smithi005 bash[38535]: cephadm 2024-02-17T23:15:41.236004+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Saving service mgr spec with placement count:2 smithi005=y,smithi080=x 2024-02-17T23:15:42.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:42 smithi005 bash[38535]: cephadm 2024-02-17T23:15:41.246286+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Deploying daemon mgr.x on smithi080 2024-02-17T23:15:42.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:42 smithi005 bash[38535]: cluster 2024-02-17T23:15:41.657228+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-02-17T23:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-02-17T23:15:42.639 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000100086 s, 5.1 MB/s 2024-02-17T23:15:42.640 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-17T23:15:42.700 DEBUG:teuthology.orchestra.run.smithi005:> stat /dev/vg_nvme/lv_4 2024-02-17T23:15:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-17T23:15:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T23:15:42.759 INFO:teuthology.orchestra.run.smithi005.stdout:Device: 6h/6d Inode: 168231 Links: 1 2024-02-17T23:15:42.759 INFO:teuthology.orchestra.run.smithi005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T23:15:42.759 INFO:teuthology.orchestra.run.smithi005.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T23:15:42.759 INFO:teuthology.orchestra.run.smithi005.stdout:Access: 2024-02-17 23:15:06.139470509 +0000 2024-02-17T23:15:42.759 INFO:teuthology.orchestra.run.smithi005.stdout:Modify: 2024-02-17 23:11:36.769384070 +0000 2024-02-17T23:15:42.759 INFO:teuthology.orchestra.run.smithi005.stdout:Change: 2024-02-17 23:11:36.769384070 +0000 2024-02-17T23:15:42.759 INFO:teuthology.orchestra.run.smithi005.stdout: Birth: - 2024-02-17T23:15:42.759 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-17T23:15:42.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records in 2024-02-17T23:15:42.826 INFO:teuthology.orchestra.run.smithi005.stderr:1+0 records out 2024-02-17T23:15:42.827 INFO:teuthology.orchestra.run.smithi005.stderr:512 bytes copied, 0.000109603 s, 4.7 MB/s 2024-02-17T23:15:42.828 DEBUG:teuthology.orchestra.run.smithi005:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-17T23:15:42.887 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-17T23:15:42.887 DEBUG:teuthology.orchestra.run.smithi080:> dd if=/scratch_devs of=/dev/stdout 2024-02-17T23:15:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:42 smithi080 bash[35203]: audit 2024-02-17T23:15:41.235354+0000 mgr.y (mgr.14140) 39 : audit [DBG] from='client.34103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi005=y;smithi080=x", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:15:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:42 smithi080 bash[35203]: cephadm 2024-02-17T23:15:41.236004+0000 mgr.y (mgr.14140) 40 : cephadm [INF] Saving service mgr spec with placement count:2 smithi005=y,smithi080=x 2024-02-17T23:15:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:42 smithi080 bash[35203]: cephadm 2024-02-17T23:15:41.246286+0000 mgr.y (mgr.14140) 41 : cephadm [INF] Deploying daemon mgr.x on smithi080 2024-02-17T23:15:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:42 smithi080 bash[35203]: cluster 2024-02-17T23:15:41.657228+0000 mgr.y (mgr.14140) 42 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:42.908 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-02-17T23:15:42.908 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_1 2024-02-17T23:15:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-02-17T23:15:42.967 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T23:15:42.967 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 170010 Links: 1 2024-02-17T23:15:42.968 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T23:15:42.968 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T23:15:42.968 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-17 23:15:42.954952842 +0000 2024-02-17T23:15:42.968 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-17 23:11:30.610065885 +0000 2024-02-17T23:15:42.968 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-17 23:11:30.610065885 +0000 2024-02-17T23:15:42.968 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-17T23:15:42.968 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-02-17T23:15:43.114 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-17T23:15:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-17T23:15:43.115 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.00024057 s, 2.1 MB/s 2024-02-17T23:15:43.116 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-02-17T23:15:43.135 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_2 2024-02-17T23:15:43.193 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-02-17T23:15:43.193 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T23:15:43.193 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 169109 Links: 1 2024-02-17T23:15:43.193 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T23:15:43.193 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T23:15:43.193 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-17 23:15:43.072950226 +0000 2024-02-17T23:15:43.193 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-17 23:11:30.972058005 +0000 2024-02-17T23:15:43.193 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-17 23:11:30.972058005 +0000 2024-02-17T23:15:43.194 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-17T23:15:43.194 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-02-17T23:15:43.257 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:15:43 smithi080 podman[36002]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.x" found: no such container 2024-02-17T23:15:43.258 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:15:43 smithi080 systemd[1]: Started Ceph mgr.x for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:15:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-17T23:15:43.259 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-17T23:15:43.260 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000240421 s, 2.1 MB/s 2024-02-17T23:15:43.261 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-02-17T23:15:43.321 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_3 2024-02-17T23:15:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-02-17T23:15:43.379 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T23:15:43.379 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 169184 Links: 1 2024-02-17T23:15:43.379 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T23:15:43.379 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T23:15:43.379 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-17 23:15:43.072950226 +0000 2024-02-17T23:15:43.379 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-17 23:11:31.316050516 +0000 2024-02-17T23:15:43.379 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-17 23:11:31.316050516 +0000 2024-02-17T23:15:43.380 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-17T23:15:43.380 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-02-17T23:15:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-17T23:15:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-17T23:15:43.452 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.000168818 s, 3.0 MB/s 2024-02-17T23:15:43.453 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-02-17T23:15:43.511 DEBUG:teuthology.orchestra.run.smithi080:> stat /dev/vg_nvme/lv_4 2024-02-17T23:15:43.569 INFO:teuthology.orchestra.run.smithi080.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-02-17T23:15:43.569 INFO:teuthology.orchestra.run.smithi080.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-02-17T23:15:43.569 INFO:teuthology.orchestra.run.smithi080.stdout:Device: 6h/6d Inode: 168245 Links: 1 2024-02-17T23:15:43.569 INFO:teuthology.orchestra.run.smithi080.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-02-17T23:15:43.569 INFO:teuthology.orchestra.run.smithi080.stdout:Context: system_u:object_r:device_t:s0 2024-02-17T23:15:43.569 INFO:teuthology.orchestra.run.smithi080.stdout:Access: 2024-02-17 23:15:43.072950226 +0000 2024-02-17T23:15:43.569 INFO:teuthology.orchestra.run.smithi080.stdout:Modify: 2024-02-17 23:11:31.668042853 +0000 2024-02-17T23:15:43.569 INFO:teuthology.orchestra.run.smithi080.stdout:Change: 2024-02-17 23:11:31.668042853 +0000 2024-02-17T23:15:43.569 INFO:teuthology.orchestra.run.smithi080.stdout: Birth: - 2024-02-17T23:15:43.570 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-02-17T23:15:43.634 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:43 smithi080 bash[35203]: audit 2024-02-17T23:15:43.173507+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:43.634 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:43 smithi080 bash[35203]: audit 2024-02-17T23:15:43.176638+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:43.634 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:43 smithi080 bash[35203]: audit 2024-02-17T23:15:43.177318+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:15:43.635 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records in 2024-02-17T23:15:43.635 INFO:teuthology.orchestra.run.smithi080.stderr:1+0 records out 2024-02-17T23:15:43.635 INFO:teuthology.orchestra.run.smithi080.stderr:512 bytes copied, 0.00020278 s, 2.5 MB/s 2024-02-17T23:15:43.636 DEBUG:teuthology.orchestra.run.smithi080:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-02-17T23:15:43.697 INFO:tasks.cephadm:Deploying osd.0 on smithi005 with /dev/vg_nvme/lv_4... 2024-02-17T23:15:43.697 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-17T23:15:43.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:43 smithi005 bash[35193]: audit 2024-02-17T23:15:43.173507+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:43.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:43 smithi005 bash[35193]: audit 2024-02-17T23:15:43.176638+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:43.728 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:43 smithi005 bash[35193]: audit 2024-02-17T23:15:43.177318+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:15:43.729 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:43 smithi005 bash[38535]: audit 2024-02-17T23:15:43.173507+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:43.729 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:43 smithi005 bash[38535]: audit 2024-02-17T23:15:43.176638+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:31.819487\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:43.729 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:43 smithi005 bash[38535]: audit 2024-02-17T23:15:43.177318+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:15:44.892 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[35193]: cluster 2024-02-17T23:15:43.657514+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:44.892 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[35193]: audit 2024-02-17T23:15:44.397574+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_daemon_update\": \"2024-02-17T23:15:44.396894\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:44.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[38535]: cluster 2024-02-17T23:15:43.657514+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:44.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[38535]: audit 2024-02-17T23:15:44.397574+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_daemon_update\": \"2024-02-17T23:15:44.396894\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:44.893 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[35193]: audit 2024-02-17T23:15:44.400516+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_daemon_update\": \"2024-02-17T23:15:44.396894\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:44.893 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[35193]: audit 2024-02-17T23:15:44.401553+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-17T23:15:44.893 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[35193]: audit 2024-02-17T23:15:44.402101+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:44.893 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[35193]: audit 2024-02-17T23:15:44.402827+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-17T23:15:44.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[38535]: audit 2024-02-17T23:15:44.400516+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_daemon_update\": \"2024-02-17T23:15:44.396894\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:44.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[38535]: audit 2024-02-17T23:15:44.401553+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-17T23:15:44.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[38535]: audit 2024-02-17T23:15:44.402101+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:44.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:44 smithi005 bash[38535]: audit 2024-02-17T23:15:44.402827+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-17T23:15:45.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:44 smithi080 bash[35203]: cluster 2024-02-17T23:15:43.657514+0000 mgr.y (mgr.14140) 43 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:45.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:44 smithi080 bash[35203]: audit 2024-02-17T23:15:44.397574+0000 mon.a (mon.0) 174 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_daemon_update\": \"2024-02-17T23:15:44.396894\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:15:45.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:44 smithi080 bash[35203]: audit 2024-02-17T23:15:44.400516+0000 mon.a (mon.0) 175 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}}, \"last_daemon_update\": \"2024-02-17T23:15:44.396894\", \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:15:45.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:44 smithi080 bash[35203]: audit 2024-02-17T23:15:44.401553+0000 mon.a (mon.0) 176 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2024-02-17T23:15:45.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:44 smithi080 bash[35203]: audit 2024-02-17T23:15:44.402101+0000 mon.a (mon.0) 177 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:45.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:44 smithi080 bash[35203]: audit 2024-02-17T23:15:44.402827+0000 mon.a (mon.0) 178 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2024-02-17T23:15:45.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:45 smithi005 bash[35193]: cephadm 2024-02-17T23:15:44.401376+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-17T23:15:45.858 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:45 smithi005 bash[35193]: cephadm 2024-02-17T23:15:44.402505+0000 mgr.y (mgr.14140) 45 : cephadm [INF] Reconfiguring daemon mgr.y on smithi005 2024-02-17T23:15:45.858 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:45 smithi005 bash[38535]: cephadm 2024-02-17T23:15:44.401376+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-17T23:15:45.858 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:45 smithi005 bash[38535]: cephadm 2024-02-17T23:15:44.402505+0000 mgr.y (mgr.14140) 45 : cephadm [INF] Reconfiguring daemon mgr.y on smithi005 2024-02-17T23:15:46.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:45 smithi080 bash[35203]: cephadm 2024-02-17T23:15:44.401376+0000 mgr.y (mgr.14140) 44 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2024-02-17T23:15:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:45 smithi080 bash[35203]: cephadm 2024-02-17T23:15:44.402505+0000 mgr.y (mgr.14140) 45 : cephadm [INF] Reconfiguring daemon mgr.y on smithi005 2024-02-17T23:15:46.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:46 smithi005 bash[35193]: cluster 2024-02-17T23:15:45.657726+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:46.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:46 smithi005 bash[35193]: audit 2024-02-17T23:15:46.572370+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:15:46.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:46 smithi005 bash[38535]: cluster 2024-02-17T23:15:45.657726+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:46.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:46 smithi005 bash[38535]: audit 2024-02-17T23:15:46.572370+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:15:46.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:46 smithi005 bash[35193]: audit 2024-02-17T23:15:46.575113+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:15:46.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:46 smithi005 bash[35193]: audit 2024-02-17T23:15:46.575913+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:15:46.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:46 smithi005 bash[38535]: audit 2024-02-17T23:15:46.575113+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:15:46.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:46 smithi005 bash[38535]: audit 2024-02-17T23:15:46.575913+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:15:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-17T23:15:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-17T23:15:46.903 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-02-17T23:15:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-02-17T23:15:46.903 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00812024 s, 1.3 GB/s 2024-02-17T23:15:46.903 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-02-17T23:15:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:46 smithi080 bash[35203]: cluster 2024-02-17T23:15:45.657726+0000 mgr.y (mgr.14140) 46 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:46 smithi080 bash[35203]: audit 2024-02-17T23:15:46.572370+0000 mon.a (mon.0) 179 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:15:47.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:46 smithi080 bash[35203]: audit 2024-02-17T23:15:46.575113+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152270\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:08.152384\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:15:47.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:46 smithi080 bash[35203]: audit 2024-02-17T23:15:46.575913+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:15:47.904 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:47 smithi005 bash[35193]: cluster 2024-02-17T23:15:47.408657+0000 mon.a (mon.0) 182 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:15:47.904 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:47 smithi005 bash[35193]: audit 2024-02-17T23:15:47.409229+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.80:0/3259779639' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:15:47.904 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:47 smithi005 bash[35193]: audit 2024-02-17T23:15:47.410220+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.80:0/3259779639' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:15:47.905 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:47 smithi005 bash[38535]: cluster 2024-02-17T23:15:47.408657+0000 mon.a (mon.0) 182 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:15:47.905 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:47 smithi005 bash[38535]: audit 2024-02-17T23:15:47.409229+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.80:0/3259779639' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:15:47.905 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:47 smithi005 bash[38535]: audit 2024-02-17T23:15:47.410220+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.80:0/3259779639' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:15:48.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:47 smithi080 bash[35203]: cluster 2024-02-17T23:15:47.408657+0000 mon.a (mon.0) 182 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:15:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:47 smithi080 bash[35203]: audit 2024-02-17T23:15:47.409229+0000 mon.b (mon.2) 3 : audit [DBG] from='mgr.? 172.21.15.80:0/3259779639' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:15:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:47 smithi080 bash[35203]: audit 2024-02-17T23:15:47.410220+0000 mon.b (mon.2) 4 : audit [DBG] from='mgr.? 172.21.15.80:0/3259779639' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:15:48.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi005:vg_nvme/lv_4 2024-02-17T23:15:48.943 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:48 smithi005 bash[35193]: cluster 2024-02-17T23:15:47.653899+0000 mon.a (mon.0) 183 : cluster [DBG] mgrmap e14: y(active, since 84s), standbys: x 2024-02-17T23:15:48.943 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:48 smithi005 bash[35193]: audit 2024-02-17T23:15:47.654025+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:15:48.943 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:48 smithi005 bash[35193]: cluster 2024-02-17T23:15:47.657988+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:48.943 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:48 smithi005 bash[38535]: cluster 2024-02-17T23:15:47.653899+0000 mon.a (mon.0) 183 : cluster [DBG] mgrmap e14: y(active, since 84s), standbys: x 2024-02-17T23:15:48.943 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:48 smithi005 bash[38535]: audit 2024-02-17T23:15:47.654025+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:15:48.943 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:48 smithi005 bash[38535]: cluster 2024-02-17T23:15:47.657988+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:48.944 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:48 smithi005 bash[35193]: audit 2024-02-17T23:15:47.817827+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_daemon_update\": \"2024-02-17T23:15:47.817305\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:15:48.944 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:48 smithi005 bash[35193]: audit 2024-02-17T23:15:47.820208+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_daemon_update\": \"2024-02-17T23:15:47.817305\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:15:48.944 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:48 smithi005 bash[38535]: audit 2024-02-17T23:15:47.817827+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_daemon_update\": \"2024-02-17T23:15:47.817305\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:15:48.944 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:48 smithi005 bash[38535]: audit 2024-02-17T23:15:47.820208+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_daemon_update\": \"2024-02-17T23:15:47.817305\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:15:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:48 smithi080 bash[35203]: cluster 2024-02-17T23:15:47.653899+0000 mon.a (mon.0) 183 : cluster [DBG] mgrmap e14: y(active, since 84s), standbys: x 2024-02-17T23:15:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:48 smithi080 bash[35203]: audit 2024-02-17T23:15:47.654025+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:15:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:48 smithi080 bash[35203]: cluster 2024-02-17T23:15:47.657988+0000 mgr.y (mgr.14140) 47 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:48 smithi080 bash[35203]: audit 2024-02-17T23:15:47.817827+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_daemon_update\": \"2024-02-17T23:15:47.817305\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:15:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:48 smithi080 bash[35203]: audit 2024-02-17T23:15:47.820208+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}}, \"last_daemon_update\": \"2024-02-17T23:15:47.817305\", \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:15:50.990 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:50 smithi005 bash[35193]: cluster 2024-02-17T23:15:49.658255+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:50.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:50 smithi005 bash[35193]: audit 2024-02-17T23:15:50.350726+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:15:50.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:50 smithi005 bash[35193]: audit 2024-02-17T23:15:50.351295+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:50.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:50 smithi005 bash[35193]: audit 2024-02-17T23:15:50.351960+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:15:50.991 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:50 smithi005 bash[38535]: cluster 2024-02-17T23:15:49.658255+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:50.991 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:50 smithi005 bash[38535]: audit 2024-02-17T23:15:50.350726+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:15:50.991 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:50 smithi005 bash[38535]: audit 2024-02-17T23:15:50.351295+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:50.991 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:50 smithi005 bash[38535]: audit 2024-02-17T23:15:50.351960+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:15:51.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:50 smithi080 bash[35203]: cluster 2024-02-17T23:15:49.658255+0000 mgr.y (mgr.14140) 48 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:51.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:50 smithi080 bash[35203]: audit 2024-02-17T23:15:50.350726+0000 mon.a (mon.0) 187 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:15:51.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:50 smithi080 bash[35203]: audit 2024-02-17T23:15:50.351295+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:15:51.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:50 smithi080 bash[35203]: audit 2024-02-17T23:15:50.351960+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:15:52.086 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:51 smithi005 bash[35193]: audit 2024-02-17T23:15:50.349699+0000 mgr.y (mgr.14140) 49 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:15:52.086 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:51 smithi005 bash[35193]: cephadm 2024-02-17T23:15:50.350464+0000 mgr.y (mgr.14140) 50 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:15:52.086 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:51 smithi005 bash[38535]: audit 2024-02-17T23:15:50.349699+0000 mgr.y (mgr.14140) 49 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:15:52.086 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:51 smithi005 bash[38535]: cephadm 2024-02-17T23:15:50.350464+0000 mgr.y (mgr.14140) 50 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:15:52.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:51 smithi080 bash[35203]: audit 2024-02-17T23:15:50.349699+0000 mgr.y (mgr.14140) 49 : audit [DBG] from='client.24115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:15:52.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:51 smithi080 bash[35203]: cephadm 2024-02-17T23:15:50.350464+0000 mgr.y (mgr.14140) 50 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:15:53.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:52 smithi005 bash[35193]: cluster 2024-02-17T23:15:51.658542+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:53.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:52 smithi005 bash[38535]: cluster 2024-02-17T23:15:51.658542+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:53.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:52 smithi080 bash[35203]: cluster 2024-02-17T23:15:51.658542+0000 mgr.y (mgr.14140) 51 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[35193]: audit 2024-02-17T23:15:52.783533+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.5:0/3384077669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c17641c-5dc3-4499-9f48-d83bc5083c0d"}]: dispatch 2024-02-17T23:15:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[35193]: audit 2024-02-17T23:15:52.783775+0000 mon.a (mon.0) 190 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c17641c-5dc3-4499-9f48-d83bc5083c0d"}]: dispatch 2024-02-17T23:15:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[35193]: audit 2024-02-17T23:15:52.786809+0000 mon.a (mon.0) 191 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c17641c-5dc3-4499-9f48-d83bc5083c0d"}]': finished 2024-02-17T23:15:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[35193]: cluster 2024-02-17T23:15:52.786844+0000 mon.a (mon.0) 192 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-17T23:15:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[35193]: audit 2024-02-17T23:15:52.786925+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:15:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[35193]: audit 2024-02-17T23:15:53.542527+0000 mon.a (mon.0) 194 : audit [DBG] from='client.? 172.21.15.5:0/2150703476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:15:54.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[38535]: audit 2024-02-17T23:15:52.783533+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.5:0/3384077669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c17641c-5dc3-4499-9f48-d83bc5083c0d"}]: dispatch 2024-02-17T23:15:54.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[38535]: audit 2024-02-17T23:15:52.783775+0000 mon.a (mon.0) 190 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c17641c-5dc3-4499-9f48-d83bc5083c0d"}]: dispatch 2024-02-17T23:15:54.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[38535]: audit 2024-02-17T23:15:52.786809+0000 mon.a (mon.0) 191 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c17641c-5dc3-4499-9f48-d83bc5083c0d"}]': finished 2024-02-17T23:15:54.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[38535]: cluster 2024-02-17T23:15:52.786844+0000 mon.a (mon.0) 192 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-17T23:15:54.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[38535]: audit 2024-02-17T23:15:52.786925+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:15:54.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:53 smithi005 bash[38535]: audit 2024-02-17T23:15:53.542527+0000 mon.a (mon.0) 194 : audit [DBG] from='client.? 172.21.15.5:0/2150703476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:15:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:53 smithi080 bash[35203]: audit 2024-02-17T23:15:52.783533+0000 mon.c (mon.1) 4 : audit [INF] from='client.? 172.21.15.5:0/3384077669' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c17641c-5dc3-4499-9f48-d83bc5083c0d"}]: dispatch 2024-02-17T23:15:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:53 smithi080 bash[35203]: audit 2024-02-17T23:15:52.783775+0000 mon.a (mon.0) 190 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "7c17641c-5dc3-4499-9f48-d83bc5083c0d"}]: dispatch 2024-02-17T23:15:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:53 smithi080 bash[35203]: audit 2024-02-17T23:15:52.786809+0000 mon.a (mon.0) 191 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "7c17641c-5dc3-4499-9f48-d83bc5083c0d"}]': finished 2024-02-17T23:15:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:53 smithi080 bash[35203]: cluster 2024-02-17T23:15:52.786844+0000 mon.a (mon.0) 192 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2024-02-17T23:15:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:53 smithi080 bash[35203]: audit 2024-02-17T23:15:52.786925+0000 mon.a (mon.0) 193 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:15:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:53 smithi080 bash[35203]: audit 2024-02-17T23:15:53.542527+0000 mon.a (mon.0) 194 : audit [DBG] from='client.? 172.21.15.5:0/2150703476' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:15:55.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:54 smithi005 bash[35193]: cluster 2024-02-17T23:15:53.658762+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:55.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:54 smithi005 bash[38535]: cluster 2024-02-17T23:15:53.658762+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:55.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:54 smithi080 bash[35203]: cluster 2024-02-17T23:15:53.658762+0000 mgr.y (mgr.14140) 52 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:57.089 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:56 smithi005 bash[35193]: cluster 2024-02-17T23:15:55.659029+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:57.089 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:56 smithi005 bash[35193]: audit 2024-02-17T23:15:56.265226+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:15:57.090 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:56 smithi005 bash[38535]: cluster 2024-02-17T23:15:55.659029+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:57.090 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:56 smithi005 bash[38535]: audit 2024-02-17T23:15:56.265226+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:15:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:56 smithi080 bash[35203]: cluster 2024-02-17T23:15:55.659029+0000 mgr.y (mgr.14140) 53 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:56 smithi080 bash[35203]: audit 2024-02-17T23:15:56.265226+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:15:58.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:58 smithi005 bash[35193]: cluster 2024-02-17T23:15:57.659291+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:58.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:58 smithi005 bash[38535]: cluster 2024-02-17T23:15:57.659291+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:15:59.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:58 smithi080 bash[35203]: cluster 2024-02-17T23:15:57.659291+0000 mgr.y (mgr.14140) 54 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:00.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:59 smithi005 bash[35193]: audit 2024-02-17T23:15:59.405928+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-17T23:16:00.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:59 smithi005 bash[35193]: audit 2024-02-17T23:15:59.406755+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:00.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:15:59 smithi005 bash[35193]: audit 2024-02-17T23:15:59.407628+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-17T23:16:00.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:59 smithi005 bash[38535]: audit 2024-02-17T23:15:59.405928+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-17T23:16:00.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:59 smithi005 bash[38535]: audit 2024-02-17T23:15:59.406755+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:00.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:15:59 smithi005 bash[38535]: audit 2024-02-17T23:15:59.407628+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-17T23:16:00.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:59 smithi080 bash[35203]: audit 2024-02-17T23:15:59.405928+0000 mon.a (mon.0) 196 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-17T23:16:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:59 smithi080 bash[35203]: audit 2024-02-17T23:15:59.406755+0000 mon.a (mon.0) 197 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:15:59 smithi080 bash[35203]: audit 2024-02-17T23:15:59.407628+0000 mon.a (mon.0) 198 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2024-02-17T23:16:00.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:00 smithi005 bash[38535]: cephadm 2024-02-17T23:15:59.407344+0000 mgr.y (mgr.14140) 55 : cephadm [INF] Deploying daemon osd.0 on smithi005 2024-02-17T23:16:00.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:00 smithi005 bash[38535]: cluster 2024-02-17T23:15:59.659505+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:00.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:00 smithi005 bash[35193]: cephadm 2024-02-17T23:15:59.407344+0000 mgr.y (mgr.14140) 55 : cephadm [INF] Deploying daemon osd.0 on smithi005 2024-02-17T23:16:00.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:00 smithi005 bash[35193]: cluster 2024-02-17T23:15:59.659505+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:01.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:00 smithi080 bash[35203]: cephadm 2024-02-17T23:15:59.407344+0000 mgr.y (mgr.14140) 55 : cephadm [INF] Deploying daemon osd.0 on smithi005 2024-02-17T23:16:01.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:00 smithi080 bash[35203]: cluster 2024-02-17T23:15:59.659505+0000 mgr.y (mgr.14140) 56 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:01.276 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 0 on host 'smithi005' 2024-02-17T23:16:01.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:01 smithi005 bash[35193]: audit 2024-02-17T23:16:01.268888+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:01.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:01 smithi005 bash[38535]: audit 2024-02-17T23:16:01.268888+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:01.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:01 smithi005 bash[35193]: audit 2024-02-17T23:16:01.269592+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:01.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:01 smithi005 bash[35193]: audit 2024-02-17T23:16:01.272330+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:01.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:01 smithi005 bash[38535]: audit 2024-02-17T23:16:01.269592+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:01.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:01 smithi005 bash[38535]: audit 2024-02-17T23:16:01.272330+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:02.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:01 smithi080 bash[35203]: audit 2024-02-17T23:16:01.268888+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:02.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:01 smithi080 bash[35203]: audit 2024-02-17T23:16:01.269592+0000 mon.a (mon.0) 200 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:02.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:01 smithi080 bash[35203]: audit 2024-02-17T23:16:01.272330+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817120\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817199\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:47.817232\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_device_update\": \"2024-02-17T23:14:31.171746\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:03.088 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:02 smithi005 bash[35193]: cluster 2024-02-17T23:16:01.659752+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:03.088 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:02 smithi005 bash[38535]: cluster 2024-02-17T23:16:01.659752+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:03.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:02 smithi080 bash[35203]: cluster 2024-02-17T23:16:01.659752+0000 mgr.y (mgr.14140) 57 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:04.360 DEBUG:teuthology.orchestra.run.smithi005:osd.0> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.0.service 2024-02-17T23:16:04.363 INFO:tasks.cephadm:Deploying osd.1 on smithi005 with /dev/vg_nvme/lv_3... 2024-02-17T23:16:04.363 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-17T23:16:04.393 INFO:journalctl@ceph.osd.0.smithi005.stdout:-- Logs begin at Sat 2024-02-17 23:05:20 UTC. -- 2024-02-17T23:16:04.842 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:04 smithi005 bash[35193]: cluster 2024-02-17T23:16:03.660004+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:04.842 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:04 smithi005 bash[35193]: audit 2024-02-17T23:16:03.880769+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:04.843 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:04 smithi005 bash[35193]: audit 2024-02-17T23:16:03.883520+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:04.843 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:04 smithi005 bash[35193]: audit 2024-02-17T23:16:03.884006+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:04.843 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:04 smithi005 bash[38535]: cluster 2024-02-17T23:16:03.660004+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:04.843 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:04 smithi005 bash[38535]: audit 2024-02-17T23:16:03.880769+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:04.843 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:04 smithi005 bash[38535]: audit 2024-02-17T23:16:03.883520+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:04.843 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:04 smithi005 bash[38535]: audit 2024-02-17T23:16:03.884006+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:05.125 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:16:04 smithi005 bash[40824]: debug 2024-02-17T23:16:04.839+0000 7f3242e2cec0 -1 osd.0 0 log_to_monitors {default=true} 2024-02-17T23:16:05.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:04 smithi080 bash[35203]: cluster 2024-02-17T23:16:03.660004+0000 mgr.y (mgr.14140) 58 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:05.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:04 smithi080 bash[35203]: audit 2024-02-17T23:16:03.880769+0000 mon.a (mon.0) 202 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:05.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:04 smithi080 bash[35203]: audit 2024-02-17T23:16:03.883520+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:05.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:04 smithi080 bash[35203]: audit 2024-02-17T23:16:03.884006+0000 mon.a (mon.0) 204 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:05.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:05 smithi005 bash[35193]: audit 2024-02-17T23:16:04.844045+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2278288718,v1:172.21.15.5:6803/2278288718]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:16:05.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:05 smithi005 bash[35193]: audit 2024-02-17T23:16:04.844333+0000 mon.a (mon.0) 205 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:16:05.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:05 smithi005 bash[38535]: audit 2024-02-17T23:16:04.844045+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2278288718,v1:172.21.15.5:6803/2278288718]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:16:05.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:05 smithi005 bash[38535]: audit 2024-02-17T23:16:04.844333+0000 mon.a (mon.0) 205 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:16:06.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:05 smithi080 bash[35203]: audit 2024-02-17T23:16:04.844045+0000 mon.c (mon.1) 5 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2278288718,v1:172.21.15.5:6803/2278288718]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:16:06.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:05 smithi080 bash[35203]: audit 2024-02-17T23:16:04.844333+0000 mon.a (mon.0) 205 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:16:06.901 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-17T23:16:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-17T23:16:06.902 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-02-17T23:16:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-02-17T23:16:06.902 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00904677 s, 1.2 GB/s 2024-02-17T23:16:06.902 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-02-17T23:16:06.937 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[40824]: debug 2024-02-17T23:16:06.657+0000 7f3227bd9700 -1 osd.0 0 waiting for initial osdmap 2024-02-17T23:16:06.937 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[40824]: debug 2024-02-17T23:16:06.660+0000 7f3232df5700 -1 osd.0 9 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-17T23:16:06.938 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[38535]: audit 2024-02-17T23:16:05.649521+0000 mon.a (mon.0) 206 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-17T23:16:06.938 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[38535]: cluster 2024-02-17T23:16:05.649556+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-17T23:16:06.938 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[38535]: audit 2024-02-17T23:16:05.649672+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:16:06.938 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[38535]: audit 2024-02-17T23:16:05.650059+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2278288718,v1:172.21.15.5:6803/2278288718]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:06.938 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[38535]: audit 2024-02-17T23:16:05.650361+0000 mon.a (mon.0) 209 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:06.938 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[38535]: cluster 2024-02-17T23:16:05.660181+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:06.938 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[38535]: cluster 2024-02-17T23:16:05.816978+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:16:06.938 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[38535]: cluster 2024-02-17T23:16:05.817025+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:16:06.938 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[35193]: audit 2024-02-17T23:16:05.649521+0000 mon.a (mon.0) 206 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-17T23:16:06.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[35193]: cluster 2024-02-17T23:16:05.649556+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-17T23:16:06.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[35193]: audit 2024-02-17T23:16:05.649672+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:16:06.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[35193]: audit 2024-02-17T23:16:05.650059+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2278288718,v1:172.21.15.5:6803/2278288718]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:06.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[35193]: audit 2024-02-17T23:16:05.650361+0000 mon.a (mon.0) 209 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:06.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[35193]: cluster 2024-02-17T23:16:05.660181+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:06.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[35193]: cluster 2024-02-17T23:16:05.816978+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:16:06.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:06 smithi005 bash[35193]: cluster 2024-02-17T23:16:05.817025+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:16:07.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:06 smithi080 bash[35203]: audit 2024-02-17T23:16:05.649521+0000 mon.a (mon.0) 206 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-17T23:16:07.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:06 smithi080 bash[35203]: cluster 2024-02-17T23:16:05.649556+0000 mon.a (mon.0) 207 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2024-02-17T23:16:07.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:06 smithi080 bash[35203]: audit 2024-02-17T23:16:05.649672+0000 mon.a (mon.0) 208 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:16:07.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:06 smithi080 bash[35203]: audit 2024-02-17T23:16:05.650059+0000 mon.c (mon.1) 6 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2278288718,v1:172.21.15.5:6803/2278288718]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:07.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:06 smithi080 bash[35203]: audit 2024-02-17T23:16:05.650361+0000 mon.a (mon.0) 209 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:07.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:06 smithi080 bash[35203]: cluster 2024-02-17T23:16:05.660181+0000 mgr.y (mgr.14140) 59 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2024-02-17T23:16:07.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:06 smithi080 bash[35203]: cluster 2024-02-17T23:16:05.816978+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:16:07.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:06 smithi080 bash[35203]: cluster 2024-02-17T23:16:05.817025+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:16:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:07 smithi005 bash[35193]: audit 2024-02-17T23:16:06.654952+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:16:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:07 smithi005 bash[35193]: cluster 2024-02-17T23:16:06.655005+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-17T23:16:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:07 smithi005 bash[35193]: audit 2024-02-17T23:16:06.655324+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:16:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:07 smithi005 bash[38535]: audit 2024-02-17T23:16:06.654952+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:16:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:07 smithi005 bash[38535]: cluster 2024-02-17T23:16:06.655005+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-17T23:16:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:07 smithi005 bash[38535]: audit 2024-02-17T23:16:06.655324+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:16:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:07 smithi080 bash[35203]: audit 2024-02-17T23:16:06.654952+0000 mon.a (mon.0) 210 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:16:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:07 smithi080 bash[35203]: cluster 2024-02-17T23:16:06.655005+0000 mon.a (mon.0) 211 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2024-02-17T23:16:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:07 smithi080 bash[35203]: audit 2024-02-17T23:16:06.655324+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:16:08.399 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi005:vg_nvme/lv_3 2024-02-17T23:16:09.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:08 smithi005 bash[35193]: cluster 2024-02-17T23:16:07.656045+0000 mon.a (mon.0) 213 : cluster [INF] osd.0 [v2:172.21.15.5:6802/2278288718,v1:172.21.15.5:6803/2278288718] boot 2024-02-17T23:16:09.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:08 smithi005 bash[35193]: cluster 2024-02-17T23:16:07.656096+0000 mon.a (mon.0) 214 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-17T23:16:09.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:08 smithi005 bash[35193]: audit 2024-02-17T23:16:07.656530+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:16:09.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:08 smithi005 bash[35193]: cluster 2024-02-17T23:16:07.660498+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v50: 1 pgs: 1 creating+peering; 0 B data, 88 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:09.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:08 smithi005 bash[35193]: cluster 2024-02-17T23:16:08.657000+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-17T23:16:09.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:08 smithi005 bash[38535]: cluster 2024-02-17T23:16:07.656045+0000 mon.a (mon.0) 213 : cluster [INF] osd.0 [v2:172.21.15.5:6802/2278288718,v1:172.21.15.5:6803/2278288718] boot 2024-02-17T23:16:09.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:08 smithi005 bash[38535]: cluster 2024-02-17T23:16:07.656096+0000 mon.a (mon.0) 214 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-17T23:16:09.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:08 smithi005 bash[38535]: audit 2024-02-17T23:16:07.656530+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:16:09.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:08 smithi005 bash[38535]: cluster 2024-02-17T23:16:07.660498+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v50: 1 pgs: 1 creating+peering; 0 B data, 88 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:09.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:08 smithi005 bash[38535]: cluster 2024-02-17T23:16:08.657000+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-17T23:16:09.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:08 smithi080 bash[35203]: cluster 2024-02-17T23:16:07.656045+0000 mon.a (mon.0) 213 : cluster [INF] osd.0 [v2:172.21.15.5:6802/2278288718,v1:172.21.15.5:6803/2278288718] boot 2024-02-17T23:16:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:08 smithi080 bash[35203]: cluster 2024-02-17T23:16:07.656096+0000 mon.a (mon.0) 214 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-02-17T23:16:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:08 smithi080 bash[35203]: audit 2024-02-17T23:16:07.656530+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:16:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:08 smithi080 bash[35203]: cluster 2024-02-17T23:16:07.660498+0000 mgr.y (mgr.14140) 60 : cluster [DBG] pgmap v50: 1 pgs: 1 creating+peering; 0 B data, 88 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:08 smithi080 bash[35203]: cluster 2024-02-17T23:16:08.657000+0000 mon.a (mon.0) 216 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2024-02-17T23:16:09.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:09 smithi005 bash[35193]: cluster 2024-02-17T23:16:08.657575+0000 mon.a (mon.0) 217 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-17T23:16:09.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:09 smithi005 bash[35193]: cluster 2024-02-17T23:16:09.658320+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-17T23:16:09.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:09 smithi005 bash[38535]: cluster 2024-02-17T23:16:08.657575+0000 mon.a (mon.0) 217 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-17T23:16:09.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:09 smithi005 bash[38535]: cluster 2024-02-17T23:16:09.658320+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-17T23:16:10.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:09 smithi080 bash[35203]: cluster 2024-02-17T23:16:08.657575+0000 mon.a (mon.0) 217 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-17T23:16:10.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:09 smithi080 bash[35203]: cluster 2024-02-17T23:16:09.658320+0000 mon.a (mon.0) 218 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2024-02-17T23:16:11.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:10 smithi005 bash[38535]: cluster 2024-02-17T23:16:09.660744+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 88 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:11.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:10 smithi005 bash[38535]: audit 2024-02-17T23:16:09.892410+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:10 smithi005 bash[35193]: cluster 2024-02-17T23:16:09.660744+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 88 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:10 smithi005 bash[35193]: audit 2024-02-17T23:16:09.892410+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:11.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:10 smithi005 bash[38535]: audit 2024-02-17T23:16:10.109434+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:10 smithi005 bash[38535]: audit 2024-02-17T23:16:10.112691+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:11.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:10 smithi005 bash[35193]: audit 2024-02-17T23:16:10.109434+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:11.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:10 smithi005 bash[35193]: audit 2024-02-17T23:16:10.112691+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:10 smithi080 bash[35203]: cluster 2024-02-17T23:16:09.660744+0000 mgr.y (mgr.14140) 61 : cluster [DBG] pgmap v53: 1 pgs: 1 creating+peering; 0 B data, 88 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:10 smithi080 bash[35203]: audit 2024-02-17T23:16:09.892410+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:10 smithi080 bash[35203]: audit 2024-02-17T23:16:10.109434+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:10 smithi080 bash[35203]: audit 2024-02-17T23:16:10.112691+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}}, \"last_daemon_update\": \"2024-02-17T23:16:03.880215\", \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:11.875 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:11 smithi005 bash[38535]: audit 2024-02-17T23:16:11.051029+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:16:11.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:11 smithi005 bash[38535]: audit 2024-02-17T23:16:11.051616+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:11.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:11 smithi005 bash[38535]: audit 2024-02-17T23:16:11.052296+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:11.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:11 smithi005 bash[35193]: audit 2024-02-17T23:16:11.051029+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:16:11.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:11 smithi005 bash[35193]: audit 2024-02-17T23:16:11.051616+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:11.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:11 smithi005 bash[35193]: audit 2024-02-17T23:16:11.052296+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:12.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:11 smithi080 bash[35203]: audit 2024-02-17T23:16:11.051029+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:16:12.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:11 smithi080 bash[35203]: audit 2024-02-17T23:16:11.051616+0000 mon.a (mon.0) 223 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:12.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:11 smithi080 bash[35203]: audit 2024-02-17T23:16:11.052296+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:12.830 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:12 smithi005 bash[35193]: audit 2024-02-17T23:16:11.050236+0000 mgr.y (mgr.14140) 62 : audit [DBG] from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:16:12.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:12 smithi005 bash[35193]: cephadm 2024-02-17T23:16:11.050784+0000 mgr.y (mgr.14140) 63 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:16:12.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:12 smithi005 bash[35193]: cluster 2024-02-17T23:16:11.660996+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 creating+peering; 0 B data, 88 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:12.831 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:12 smithi005 bash[38535]: audit 2024-02-17T23:16:11.050236+0000 mgr.y (mgr.14140) 62 : audit [DBG] from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:16:12.831 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:12 smithi005 bash[38535]: cephadm 2024-02-17T23:16:11.050784+0000 mgr.y (mgr.14140) 63 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:16:12.831 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:12 smithi005 bash[38535]: cluster 2024-02-17T23:16:11.660996+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 creating+peering; 0 B data, 88 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:13.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:12 smithi080 bash[35203]: audit 2024-02-17T23:16:11.050236+0000 mgr.y (mgr.14140) 62 : audit [DBG] from='client.14229 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:16:13.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:12 smithi080 bash[35203]: cephadm 2024-02-17T23:16:11.050784+0000 mgr.y (mgr.14140) 63 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:16:13.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:12 smithi080 bash[35203]: cluster 2024-02-17T23:16:11.660996+0000 mgr.y (mgr.14140) 64 : cluster [DBG] pgmap v54: 1 pgs: 1 creating+peering; 0 B data, 88 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:14.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:13 smithi005 bash[35193]: audit 2024-02-17T23:16:13.516809+0000 mon.a (mon.0) 225 : audit [INF] from='client.? 172.21.15.5:0/4113510585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53145211-95db-47c4-946c-d258f1bd2277"}]: dispatch 2024-02-17T23:16:14.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:13 smithi005 bash[35193]: audit 2024-02-17T23:16:13.520300+0000 mon.a (mon.0) 226 : audit [INF] from='client.? 172.21.15.5:0/4113510585' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53145211-95db-47c4-946c-d258f1bd2277"}]': finished 2024-02-17T23:16:14.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:13 smithi005 bash[35193]: cluster 2024-02-17T23:16:13.520344+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-17T23:16:14.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:13 smithi005 bash[35193]: audit 2024-02-17T23:16:13.520482+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:14.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:13 smithi005 bash[38535]: audit 2024-02-17T23:16:13.516809+0000 mon.a (mon.0) 225 : audit [INF] from='client.? 172.21.15.5:0/4113510585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53145211-95db-47c4-946c-d258f1bd2277"}]: dispatch 2024-02-17T23:16:14.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:13 smithi005 bash[38535]: audit 2024-02-17T23:16:13.520300+0000 mon.a (mon.0) 226 : audit [INF] from='client.? 172.21.15.5:0/4113510585' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53145211-95db-47c4-946c-d258f1bd2277"}]': finished 2024-02-17T23:16:14.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:13 smithi005 bash[38535]: cluster 2024-02-17T23:16:13.520344+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-17T23:16:14.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:13 smithi005 bash[38535]: audit 2024-02-17T23:16:13.520482+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:14.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:13 smithi080 bash[35203]: audit 2024-02-17T23:16:13.516809+0000 mon.a (mon.0) 225 : audit [INF] from='client.? 172.21.15.5:0/4113510585' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "53145211-95db-47c4-946c-d258f1bd2277"}]: dispatch 2024-02-17T23:16:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:13 smithi080 bash[35203]: audit 2024-02-17T23:16:13.520300+0000 mon.a (mon.0) 226 : audit [INF] from='client.? 172.21.15.5:0/4113510585' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "53145211-95db-47c4-946c-d258f1bd2277"}]': finished 2024-02-17T23:16:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:13 smithi080 bash[35203]: cluster 2024-02-17T23:16:13.520344+0000 mon.a (mon.0) 227 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2024-02-17T23:16:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:13 smithi080 bash[35203]: audit 2024-02-17T23:16:13.520482+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:15.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:14 smithi005 bash[35193]: cluster 2024-02-17T23:16:13.661264+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:15.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:14 smithi005 bash[35193]: audit 2024-02-17T23:16:14.237607+0000 mon.a (mon.0) 229 : audit [DBG] from='client.? 172.21.15.5:0/3733574820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:16:15.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:14 smithi005 bash[35193]: cluster 2024-02-17T23:16:14.640640+0000 mon.a (mon.0) 230 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-17T23:16:15.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:14 smithi005 bash[38535]: cluster 2024-02-17T23:16:13.661264+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:15.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:14 smithi005 bash[38535]: audit 2024-02-17T23:16:14.237607+0000 mon.a (mon.0) 229 : audit [DBG] from='client.? 172.21.15.5:0/3733574820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:16:15.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:14 smithi005 bash[38535]: cluster 2024-02-17T23:16:14.640640+0000 mon.a (mon.0) 230 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-17T23:16:15.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:14 smithi080 bash[35203]: cluster 2024-02-17T23:16:13.661264+0000 mgr.y (mgr.14140) 65 : cluster [DBG] pgmap v56: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:15.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:14 smithi080 bash[35203]: audit 2024-02-17T23:16:14.237607+0000 mon.a (mon.0) 229 : audit [DBG] from='client.? 172.21.15.5:0/3733574820' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:16:15.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:14 smithi080 bash[35203]: cluster 2024-02-17T23:16:14.640640+0000 mon.a (mon.0) 230 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2024-02-17T23:16:16.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:16 smithi005 bash[38535]: cluster 2024-02-17T23:16:15.661565+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:16.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:16 smithi005 bash[35193]: cluster 2024-02-17T23:16:15.661565+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:17.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:16 smithi080 bash[35203]: cluster 2024-02-17T23:16:15.661565+0000 mgr.y (mgr.14140) 66 : cluster [DBG] pgmap v57: 1 pgs: 1 undersized+peered; 0 B data, 112 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:17.959 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:17 smithi005 bash[35193]: audit 2024-02-17T23:16:16.922259+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:17.959 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:17 smithi005 bash[38535]: audit 2024-02-17T23:16:16.922259+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:18.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:17 smithi080 bash[35203]: audit 2024-02-17T23:16:16.922259+0000 mon.a (mon.0) 231 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:18.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:18 smithi005 bash[35193]: cluster 2024-02-17T23:16:17.661803+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:18.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:18 smithi005 bash[38535]: cluster 2024-02-17T23:16:17.661803+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:19.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:18 smithi080 bash[35203]: cluster 2024-02-17T23:16:17.661803+0000 mgr.y (mgr.14140) 67 : cluster [DBG] pgmap v58: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:21.062 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:20 smithi005 bash[38535]: cluster 2024-02-17T23:16:19.662038+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:21.063 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:20 smithi005 bash[38535]: audit 2024-02-17T23:16:19.726692+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-17T23:16:21.063 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:20 smithi005 bash[38535]: audit 2024-02-17T23:16:19.727445+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:21.063 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:20 smithi005 bash[38535]: cephadm 2024-02-17T23:16:19.727950+0000 mgr.y (mgr.14140) 69 : cephadm [INF] Deploying daemon osd.1 on smithi005 2024-02-17T23:16:21.063 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:20 smithi005 bash[38535]: audit 2024-02-17T23:16:19.728216+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-17T23:16:21.063 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:20 smithi005 bash[35193]: cluster 2024-02-17T23:16:19.662038+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:21.063 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:20 smithi005 bash[35193]: audit 2024-02-17T23:16:19.726692+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-17T23:16:21.063 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:20 smithi005 bash[35193]: audit 2024-02-17T23:16:19.727445+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:21.063 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:20 smithi005 bash[35193]: cephadm 2024-02-17T23:16:19.727950+0000 mgr.y (mgr.14140) 69 : cephadm [INF] Deploying daemon osd.1 on smithi005 2024-02-17T23:16:21.063 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:20 smithi005 bash[35193]: audit 2024-02-17T23:16:19.728216+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-17T23:16:21.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:20 smithi080 bash[35203]: cluster 2024-02-17T23:16:19.662038+0000 mgr.y (mgr.14140) 68 : cluster [DBG] pgmap v59: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:21.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:20 smithi080 bash[35203]: audit 2024-02-17T23:16:19.726692+0000 mon.a (mon.0) 232 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-17T23:16:21.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:20 smithi080 bash[35203]: audit 2024-02-17T23:16:19.727445+0000 mon.a (mon.0) 233 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:21.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:20 smithi080 bash[35203]: cephadm 2024-02-17T23:16:19.727950+0000 mgr.y (mgr.14140) 69 : cephadm [INF] Deploying daemon osd.1 on smithi005 2024-02-17T23:16:21.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:20 smithi080 bash[35203]: audit 2024-02-17T23:16:19.728216+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2024-02-17T23:16:21.504 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 1 on host 'smithi005' 2024-02-17T23:16:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:21 smithi005 bash[35193]: audit 2024-02-17T23:16:21.496439+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:21 smithi005 bash[35193]: audit 2024-02-17T23:16:21.496945+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:22.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:21 smithi005 bash[35193]: audit 2024-02-17T23:16:21.499591+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:22.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:21 smithi005 bash[38535]: audit 2024-02-17T23:16:21.496439+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:22.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:21 smithi005 bash[38535]: audit 2024-02-17T23:16:21.496945+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:22.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:21 smithi005 bash[38535]: audit 2024-02-17T23:16:21.499591+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:22.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:21 smithi080 bash[35203]: audit 2024-02-17T23:16:21.496439+0000 mon.a (mon.0) 235 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:22.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:21 smithi080 bash[35203]: audit 2024-02-17T23:16:21.496945+0000 mon.a (mon.0) 236 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:22.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:21 smithi080 bash[35203]: audit 2024-02-17T23:16:21.499591+0000 mon.a (mon.0) 237 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.879986\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880064\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880110\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:03.880142\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_device_update\": \"2024-02-17T23:16:10.108865\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:22.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:22 smithi005 bash[35193]: cluster 2024-02-17T23:16:21.662245+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:22.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:22 smithi005 bash[38535]: cluster 2024-02-17T23:16:21.662245+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:23.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:22 smithi080 bash[35203]: cluster 2024-02-17T23:16:21.662245+0000 mgr.y (mgr.14140) 70 : cluster [DBG] pgmap v60: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:24.018 DEBUG:teuthology.orchestra.run.smithi005:osd.1> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.1.service 2024-02-17T23:16:24.021 INFO:tasks.cephadm:Deploying osd.2 on smithi005 with /dev/vg_nvme/lv_2... 2024-02-17T23:16:24.021 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-17T23:16:24.057 INFO:journalctl@ceph.osd.1.smithi005.stdout:-- Logs begin at Sat 2024-02-17 23:05:20 UTC. -- 2024-02-17T23:16:25.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:24 smithi005 bash[35193]: cluster 2024-02-17T23:16:23.662565+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:25.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:24 smithi005 bash[38535]: cluster 2024-02-17T23:16:23.662565+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:25.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:24 smithi080 bash[35203]: cluster 2024-02-17T23:16:23.662565+0000 mgr.y (mgr.14140) 71 : cluster [DBG] pgmap v61: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:25.626 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:16:25 smithi005 bash[42328]: debug 2024-02-17T23:16:25.224+0000 7f9129953ec0 -1 Falling back to public interface 2024-02-17T23:16:26.080 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:16:25 smithi005 bash[42328]: debug 2024-02-17T23:16:25.771+0000 7f9129953ec0 -1 osd.1 0 log_to_monitors {default=true} 2024-02-17T23:16:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-17T23:16:26.673 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-17T23:16:26.673 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-02-17T23:16:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-02-17T23:16:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00805892 s, 1.3 GB/s 2024-02-17T23:16:26.674 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-02-17T23:16:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:26 smithi005 bash[35193]: cluster 2024-02-17T23:16:25.662812+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:26 smithi005 bash[35193]: audit 2024-02-17T23:16:25.775097+0000 mon.a (mon.0) 238 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-17T23:16:27.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:26 smithi005 bash[38535]: cluster 2024-02-17T23:16:25.662812+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:27.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:26 smithi005 bash[38535]: audit 2024-02-17T23:16:25.775097+0000 mon.a (mon.0) 238 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-17T23:16:27.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:26 smithi005 bash[35193]: audit 2024-02-17T23:16:25.843547+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:27.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:26 smithi005 bash[35193]: audit 2024-02-17T23:16:25.846346+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:27.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:26 smithi005 bash[35193]: audit 2024-02-17T23:16:25.846981+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:27.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:26 smithi005 bash[38535]: audit 2024-02-17T23:16:25.843547+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:27.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:26 smithi005 bash[38535]: audit 2024-02-17T23:16:25.846346+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:27.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:26 smithi005 bash[38535]: audit 2024-02-17T23:16:25.846981+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:27.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:26 smithi080 bash[35203]: cluster 2024-02-17T23:16:25.662812+0000 mgr.y (mgr.14140) 72 : cluster [DBG] pgmap v62: 1 pgs: 1 undersized+peered; 0 B data, 120 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:27.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:26 smithi080 bash[35203]: audit 2024-02-17T23:16:25.775097+0000 mon.a (mon.0) 238 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-17T23:16:27.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:26 smithi080 bash[35203]: audit 2024-02-17T23:16:25.843547+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:27.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:26 smithi080 bash[35203]: audit 2024-02-17T23:16:25.846346+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:27.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:26 smithi080 bash[35203]: audit 2024-02-17T23:16:25.846981+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:28.127 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[42328]: debug 2024-02-17T23:16:27.724+0000 7f910e700700 -1 osd.1 0 waiting for initial osdmap 2024-02-17T23:16:28.127 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[42328]: debug 2024-02-17T23:16:27.729+0000 7f911991c700 -1 osd.1 15 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-17T23:16:28.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[35193]: audit 2024-02-17T23:16:26.717726+0000 mon.a (mon.0) 242 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-17T23:16:28.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[35193]: cluster 2024-02-17T23:16:26.717761+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-17T23:16:28.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[35193]: audit 2024-02-17T23:16:26.718213+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:28.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[35193]: audit 2024-02-17T23:16:26.718554+0000 mon.a (mon.0) 245 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:28.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[35193]: cluster 2024-02-17T23:16:26.728468+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:16:28.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[35193]: cluster 2024-02-17T23:16:26.728505+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:16:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[38535]: audit 2024-02-17T23:16:26.717726+0000 mon.a (mon.0) 242 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-17T23:16:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[38535]: cluster 2024-02-17T23:16:26.717761+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-17T23:16:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[38535]: audit 2024-02-17T23:16:26.718213+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[38535]: audit 2024-02-17T23:16:26.718554+0000 mon.a (mon.0) 245 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:28.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[38535]: cluster 2024-02-17T23:16:26.728468+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:16:28.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:27 smithi005 bash[38535]: cluster 2024-02-17T23:16:26.728505+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:16:28.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:27 smithi080 bash[35203]: audit 2024-02-17T23:16:26.717726+0000 mon.a (mon.0) 242 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-17T23:16:28.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:27 smithi080 bash[35203]: cluster 2024-02-17T23:16:26.717761+0000 mon.a (mon.0) 243 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2024-02-17T23:16:28.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:27 smithi080 bash[35203]: audit 2024-02-17T23:16:26.718213+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:27 smithi080 bash[35203]: audit 2024-02-17T23:16:26.718554+0000 mon.a (mon.0) 245 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:27 smithi080 bash[35203]: cluster 2024-02-17T23:16:26.728468+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:16:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:27 smithi080 bash[35203]: cluster 2024-02-17T23:16:26.728505+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:16:28.232 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi005:vg_nvme/lv_2 2024-02-17T23:16:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:28 smithi005 bash[35193]: cluster 2024-02-17T23:16:27.663088+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:28 smithi005 bash[35193]: audit 2024-02-17T23:16:27.722361+0000 mon.a (mon.0) 246 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:16:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:28 smithi005 bash[35193]: cluster 2024-02-17T23:16:27.722418+0000 mon.a (mon.0) 247 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-17T23:16:29.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:28 smithi005 bash[35193]: audit 2024-02-17T23:16:27.722896+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:28 smithi005 bash[38535]: cluster 2024-02-17T23:16:27.663088+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:28 smithi005 bash[38535]: audit 2024-02-17T23:16:27.722361+0000 mon.a (mon.0) 246 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:16:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:28 smithi005 bash[38535]: cluster 2024-02-17T23:16:27.722418+0000 mon.a (mon.0) 247 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-17T23:16:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:28 smithi005 bash[38535]: audit 2024-02-17T23:16:27.722896+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:29.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:28 smithi080 bash[35203]: cluster 2024-02-17T23:16:27.663088+0000 mgr.y (mgr.14140) 73 : cluster [DBG] pgmap v64: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:29.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:28 smithi080 bash[35203]: audit 2024-02-17T23:16:27.722361+0000 mon.a (mon.0) 246 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:16:29.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:28 smithi080 bash[35203]: cluster 2024-02-17T23:16:27.722418+0000 mon.a (mon.0) 247 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2024-02-17T23:16:29.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:28 smithi080 bash[35203]: audit 2024-02-17T23:16:27.722896+0000 mon.a (mon.0) 248 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:30.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:29 smithi005 bash[35193]: cluster 2024-02-17T23:16:28.727774+0000 mon.a (mon.0) 249 : cluster [INF] osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693] boot 2024-02-17T23:16:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:29 smithi005 bash[35193]: cluster 2024-02-17T23:16:28.727815+0000 mon.a (mon.0) 250 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-17T23:16:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:29 smithi005 bash[35193]: audit 2024-02-17T23:16:28.728284+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:30.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:29 smithi005 bash[38535]: cluster 2024-02-17T23:16:28.727774+0000 mon.a (mon.0) 249 : cluster [INF] osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693] boot 2024-02-17T23:16:30.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:29 smithi005 bash[38535]: cluster 2024-02-17T23:16:28.727815+0000 mon.a (mon.0) 250 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-17T23:16:30.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:29 smithi005 bash[38535]: audit 2024-02-17T23:16:28.728284+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:30.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:29 smithi080 bash[35203]: cluster 2024-02-17T23:16:28.727774+0000 mon.a (mon.0) 249 : cluster [INF] osd.1 [v2:172.21.15.5:6810/2800558693,v1:172.21.15.5:6811/2800558693] boot 2024-02-17T23:16:30.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:29 smithi080 bash[35203]: cluster 2024-02-17T23:16:28.727815+0000 mon.a (mon.0) 250 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2024-02-17T23:16:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:29 smithi080 bash[35203]: audit 2024-02-17T23:16:28.728284+0000 mon.a (mon.0) 251 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:16:30.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:30 smithi005 bash[35193]: cluster 2024-02-17T23:16:29.663312+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:30.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:30 smithi005 bash[35193]: cluster 2024-02-17T23:16:29.736892+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-17T23:16:30.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:30 smithi005 bash[35193]: audit 2024-02-17T23:16:29.738101+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240217-231423"}]: dispatch 2024-02-17T23:16:30.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:30 smithi005 bash[35193]: audit 2024-02-17T23:16:29.740448+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240217-231423"}]': finished 2024-02-17T23:16:30.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:30 smithi005 bash[38535]: cluster 2024-02-17T23:16:29.663312+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:30.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:30 smithi005 bash[38535]: cluster 2024-02-17T23:16:29.736892+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-17T23:16:30.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:30 smithi005 bash[38535]: audit 2024-02-17T23:16:29.738101+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240217-231423"}]: dispatch 2024-02-17T23:16:30.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:30 smithi005 bash[38535]: audit 2024-02-17T23:16:29.740448+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240217-231423"}]': finished 2024-02-17T23:16:31.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:30 smithi080 bash[35203]: cluster 2024-02-17T23:16:29.663312+0000 mgr.y (mgr.14140) 74 : cluster [DBG] pgmap v67: 1 pgs: 1 undersized+peered; 0 B data, 128 KiB used, 88 GiB / 89 GiB avail 2024-02-17T23:16:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:30 smithi080 bash[35203]: cluster 2024-02-17T23:16:29.736892+0000 mon.a (mon.0) 252 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2024-02-17T23:16:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:30 smithi080 bash[35203]: audit 2024-02-17T23:16:29.738101+0000 mon.a (mon.0) 253 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240217-231423"}]: dispatch 2024-02-17T23:16:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:30 smithi080 bash[35203]: audit 2024-02-17T23:16:29.740448+0000 mon.a (mon.0) 254 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/devicehealth/last_scrape","val":"20240217-231423"}]': finished 2024-02-17T23:16:31.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[35193]: audit 2024-02-17T23:16:31.101205+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:16:31.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[35193]: audit 2024-02-17T23:16:31.101890+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:31.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[35193]: audit 2024-02-17T23:16:31.102723+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:31.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[35193]: audit 2024-02-17T23:16:31.117225+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:31.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[38535]: audit 2024-02-17T23:16:31.101205+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:16:31.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[38535]: audit 2024-02-17T23:16:31.101890+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:31.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[38535]: audit 2024-02-17T23:16:31.102723+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:31.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[38535]: audit 2024-02-17T23:16:31.117225+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:31.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[38535]: audit 2024-02-17T23:16:31.331486+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:31.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[38535]: audit 2024-02-17T23:16:31.334257+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:31.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[35193]: audit 2024-02-17T23:16:31.331486+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:31.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:31 smithi005 bash[35193]: audit 2024-02-17T23:16:31.334257+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:31 smithi080 bash[35203]: audit 2024-02-17T23:16:31.101205+0000 mon.a (mon.0) 255 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:16:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:31 smithi080 bash[35203]: audit 2024-02-17T23:16:31.101890+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:31 smithi080 bash[35203]: audit 2024-02-17T23:16:31.102723+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:31 smithi080 bash[35203]: audit 2024-02-17T23:16:31.117225+0000 mon.a (mon.0) 258 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:31 smithi080 bash[35203]: audit 2024-02-17T23:16:31.331486+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:31 smithi080 bash[35203]: audit 2024-02-17T23:16:31.334257+0000 mon.a (mon.0) 260 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}}, \"last_daemon_update\": \"2024-02-17T23:16:25.842930\", \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:32 smithi005 bash[35193]: audit 2024-02-17T23:16:31.100365+0000 mgr.y (mgr.14140) 75 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:16:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:32 smithi005 bash[35193]: cephadm 2024-02-17T23:16:31.100948+0000 mgr.y (mgr.14140) 76 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:16:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:32 smithi005 bash[35193]: cluster 2024-02-17T23:16:31.663547+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2024-02-17T23:16:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:32 smithi005 bash[38535]: audit 2024-02-17T23:16:31.100365+0000 mgr.y (mgr.14140) 75 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:16:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:32 smithi005 bash[38535]: cephadm 2024-02-17T23:16:31.100948+0000 mgr.y (mgr.14140) 76 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:16:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:32 smithi005 bash[38535]: cluster 2024-02-17T23:16:31.663547+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2024-02-17T23:16:33.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:32 smithi080 bash[35203]: audit 2024-02-17T23:16:31.100365+0000 mgr.y (mgr.14140) 75 : audit [DBG] from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:16:33.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:32 smithi080 bash[35203]: cephadm 2024-02-17T23:16:31.100948+0000 mgr.y (mgr.14140) 76 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:16:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:32 smithi080 bash[35203]: cluster 2024-02-17T23:16:31.663547+0000 mgr.y (mgr.14140) 77 : cluster [DBG] pgmap v69: 1 pgs: 1 undersized+peered; 0 B data, 272 KiB used, 177 GiB / 179 GiB avail 2024-02-17T23:16:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:33 smithi005 bash[35193]: audit 2024-02-17T23:16:33.435052+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.5:0/3985694066' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00b874d3-a65b-4855-bf32-106d604add53"}]: dispatch 2024-02-17T23:16:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:33 smithi005 bash[35193]: audit 2024-02-17T23:16:33.435354+0000 mon.a (mon.0) 261 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00b874d3-a65b-4855-bf32-106d604add53"}]: dispatch 2024-02-17T23:16:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:33 smithi005 bash[35193]: audit 2024-02-17T23:16:33.438801+0000 mon.a (mon.0) 262 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00b874d3-a65b-4855-bf32-106d604add53"}]': finished 2024-02-17T23:16:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:33 smithi005 bash[35193]: cluster 2024-02-17T23:16:33.438838+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-17T23:16:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:33 smithi005 bash[35193]: audit 2024-02-17T23:16:33.438922+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:33 smithi005 bash[38535]: audit 2024-02-17T23:16:33.435052+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.5:0/3985694066' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00b874d3-a65b-4855-bf32-106d604add53"}]: dispatch 2024-02-17T23:16:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:33 smithi005 bash[38535]: audit 2024-02-17T23:16:33.435354+0000 mon.a (mon.0) 261 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00b874d3-a65b-4855-bf32-106d604add53"}]: dispatch 2024-02-17T23:16:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:33 smithi005 bash[38535]: audit 2024-02-17T23:16:33.438801+0000 mon.a (mon.0) 262 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00b874d3-a65b-4855-bf32-106d604add53"}]': finished 2024-02-17T23:16:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:33 smithi005 bash[38535]: cluster 2024-02-17T23:16:33.438838+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-17T23:16:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:33 smithi005 bash[38535]: audit 2024-02-17T23:16:33.438922+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:34.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:33 smithi080 bash[35203]: audit 2024-02-17T23:16:33.435052+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.5:0/3985694066' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00b874d3-a65b-4855-bf32-106d604add53"}]: dispatch 2024-02-17T23:16:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:33 smithi080 bash[35203]: audit 2024-02-17T23:16:33.435354+0000 mon.a (mon.0) 261 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "00b874d3-a65b-4855-bf32-106d604add53"}]: dispatch 2024-02-17T23:16:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:33 smithi080 bash[35203]: audit 2024-02-17T23:16:33.438801+0000 mon.a (mon.0) 262 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "00b874d3-a65b-4855-bf32-106d604add53"}]': finished 2024-02-17T23:16:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:33 smithi080 bash[35203]: cluster 2024-02-17T23:16:33.438838+0000 mon.a (mon.0) 263 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2024-02-17T23:16:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:33 smithi080 bash[35203]: audit 2024-02-17T23:16:33.438922+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:35.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:34 smithi005 bash[38535]: cluster 2024-02-17T23:16:33.663765+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2024-02-17T23:16:35.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:34 smithi005 bash[38535]: audit 2024-02-17T23:16:34.178126+0000 mon.a (mon.0) 265 : audit [DBG] from='client.? 172.21.15.5:0/3880207777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:16:35.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:34 smithi005 bash[35193]: cluster 2024-02-17T23:16:33.663765+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2024-02-17T23:16:35.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:34 smithi005 bash[35193]: audit 2024-02-17T23:16:34.178126+0000 mon.a (mon.0) 265 : audit [DBG] from='client.? 172.21.15.5:0/3880207777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:16:35.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:34 smithi080 bash[35203]: cluster 2024-02-17T23:16:33.663765+0000 mgr.y (mgr.14140) 78 : cluster [DBG] pgmap v71: 1 pgs: 1 undersized+peered; 0 B data, 296 KiB used, 177 GiB / 179 GiB avail 2024-02-17T23:16:35.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:34 smithi080 bash[35203]: audit 2024-02-17T23:16:34.178126+0000 mon.a (mon.0) 265 : audit [DBG] from='client.? 172.21.15.5:0/3880207777' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:16:36.100 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:35 smithi005 bash[35193]: cluster 2024-02-17T23:16:35.664121+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:36.100 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:35 smithi005 bash[35193]: cluster 2024-02-17T23:16:35.743036+0000 mon.a (mon.0) 266 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-17T23:16:36.100 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:35 smithi005 bash[35193]: cluster 2024-02-17T23:16:35.743067+0000 mon.a (mon.0) 267 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-17T23:16:36.100 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:35 smithi005 bash[38535]: cluster 2024-02-17T23:16:35.664121+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:36.100 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:35 smithi005 bash[38535]: cluster 2024-02-17T23:16:35.743036+0000 mon.a (mon.0) 266 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-17T23:16:36.100 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:35 smithi005 bash[38535]: cluster 2024-02-17T23:16:35.743067+0000 mon.a (mon.0) 267 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-17T23:16:36.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:35 smithi080 bash[35203]: cluster 2024-02-17T23:16:35.664121+0000 mgr.y (mgr.14140) 79 : cluster [DBG] pgmap v72: 1 pgs: 1 active+undersized+degraded; 0 B data, 312 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:36.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:35 smithi080 bash[35203]: cluster 2024-02-17T23:16:35.743036+0000 mon.a (mon.0) 266 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-17T23:16:36.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:35 smithi080 bash[35203]: cluster 2024-02-17T23:16:35.743067+0000 mon.a (mon.0) 267 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2024-02-17T23:16:37.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:36 smithi005 bash[35193]: audit 2024-02-17T23:16:36.811028+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:36 smithi005 bash[38535]: audit 2024-02-17T23:16:36.811028+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:37.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:36 smithi080 bash[35203]: audit 2024-02-17T23:16:36.811028+0000 mon.a (mon.0) 268 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:37 smithi005 bash[35193]: cluster 2024-02-17T23:16:37.664446+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:38.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:37 smithi005 bash[38535]: cluster 2024-02-17T23:16:37.664446+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:38.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:37 smithi080 bash[35203]: cluster 2024-02-17T23:16:37.664446+0000 mgr.y (mgr.14140) 80 : cluster [DBG] pgmap v73: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:40.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:39 smithi005 bash[35193]: audit 2024-02-17T23:16:39.641329+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-17T23:16:40.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:39 smithi005 bash[35193]: audit 2024-02-17T23:16:39.642133+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:40.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:39 smithi005 bash[35193]: audit 2024-02-17T23:16:39.643029+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-17T23:16:40.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:39 smithi005 bash[38535]: audit 2024-02-17T23:16:39.641329+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-17T23:16:40.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:39 smithi005 bash[38535]: audit 2024-02-17T23:16:39.642133+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:40.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:39 smithi005 bash[38535]: audit 2024-02-17T23:16:39.643029+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-17T23:16:40.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:39 smithi080 bash[35203]: audit 2024-02-17T23:16:39.641329+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-17T23:16:40.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:39 smithi080 bash[35203]: audit 2024-02-17T23:16:39.642133+0000 mon.a (mon.0) 270 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:40.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:39 smithi080 bash[35203]: audit 2024-02-17T23:16:39.643029+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2024-02-17T23:16:40.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:40 smithi005 bash[38535]: cephadm 2024-02-17T23:16:39.642725+0000 mgr.y (mgr.14140) 81 : cephadm [INF] Deploying daemon osd.2 on smithi005 2024-02-17T23:16:40.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:40 smithi005 bash[38535]: cluster 2024-02-17T23:16:39.664728+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:40.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:40 smithi005 bash[35193]: cephadm 2024-02-17T23:16:39.642725+0000 mgr.y (mgr.14140) 81 : cephadm [INF] Deploying daemon osd.2 on smithi005 2024-02-17T23:16:40.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:40 smithi005 bash[35193]: cluster 2024-02-17T23:16:39.664728+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:41.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:40 smithi080 bash[35203]: cephadm 2024-02-17T23:16:39.642725+0000 mgr.y (mgr.14140) 81 : cephadm [INF] Deploying daemon osd.2 on smithi005 2024-02-17T23:16:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:40 smithi080 bash[35203]: cluster 2024-02-17T23:16:39.664728+0000 mgr.y (mgr.14140) 82 : cluster [DBG] pgmap v74: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:41.622 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 2 on host 'smithi005' 2024-02-17T23:16:41.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:41 smithi005 bash[38535]: audit 2024-02-17T23:16:41.615028+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:41.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:41 smithi005 bash[38535]: audit 2024-02-17T23:16:41.615614+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:41.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:41 smithi005 bash[38535]: audit 2024-02-17T23:16:41.617937+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:41.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:41 smithi005 bash[35193]: audit 2024-02-17T23:16:41.615028+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:41.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:41 smithi005 bash[35193]: audit 2024-02-17T23:16:41.615614+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:41.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:41 smithi005 bash[35193]: audit 2024-02-17T23:16:41.617937+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:42.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:41 smithi080 bash[35203]: audit 2024-02-17T23:16:41.615028+0000 mon.a (mon.0) 272 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:42.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:41 smithi080 bash[35203]: audit 2024-02-17T23:16:41.615614+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:42.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:41 smithi080 bash[35203]: audit 2024-02-17T23:16:41.617937+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842675\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842758\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842793\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842824\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:25.842854\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_device_update\": \"2024-02-17T23:16:31.330872\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:42.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:42 smithi005 bash[35193]: cluster 2024-02-17T23:16:41.664975+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:42.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:42 smithi005 bash[38535]: cluster 2024-02-17T23:16:41.664975+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:43.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:42 smithi080 bash[35203]: cluster 2024-02-17T23:16:41.664975+0000 mgr.y (mgr.14140) 83 : cluster [DBG] pgmap v75: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:44.787 DEBUG:teuthology.orchestra.run.smithi005:osd.2> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.2.service 2024-02-17T23:16:44.790 INFO:tasks.cephadm:Deploying osd.3 on smithi005 with /dev/vg_nvme/lv_1... 2024-02-17T23:16:44.790 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-17T23:16:44.821 INFO:journalctl@ceph.osd.2.smithi005.stdout:-- Logs begin at Sat 2024-02-17 23:05:20 UTC. -- 2024-02-17T23:16:45.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:44 smithi005 bash[35193]: cluster 2024-02-17T23:16:43.665248+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:45.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:44 smithi005 bash[38535]: cluster 2024-02-17T23:16:43.665248+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:45.126 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:16:44 smithi005 bash[43923]: debug 2024-02-17T23:16:44.843+0000 7f149adb0ec0 -1 Falling back to public interface 2024-02-17T23:16:45.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:44 smithi080 bash[35203]: cluster 2024-02-17T23:16:43.665248+0000 mgr.y (mgr.14140) 84 : cluster [DBG] pgmap v76: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:45.483 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[43923]: debug 2024-02-17T23:16:45.392+0000 7f149adb0ec0 -1 osd.2 0 log_to_monitors {default=true} 2024-02-17T23:16:45.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[38535]: audit 2024-02-17T23:16:44.926990+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:45.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[38535]: audit 2024-02-17T23:16:44.930374+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:45.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[38535]: audit 2024-02-17T23:16:44.930903+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:45.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[38535]: audit 2024-02-17T23:16:45.396643+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/2632773501,v1:172.21.15.5:6819/2632773501]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:16:45.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[38535]: audit 2024-02-17T23:16:45.396923+0000 mon.a (mon.0) 278 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:16:45.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[35193]: audit 2024-02-17T23:16:44.926990+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:45.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[35193]: audit 2024-02-17T23:16:44.930374+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:45.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[35193]: audit 2024-02-17T23:16:44.930903+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:45.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[35193]: audit 2024-02-17T23:16:45.396643+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/2632773501,v1:172.21.15.5:6819/2632773501]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:16:45.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:45 smithi005 bash[35193]: audit 2024-02-17T23:16:45.396923+0000 mon.a (mon.0) 278 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:16:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:45 smithi080 bash[35203]: audit 2024-02-17T23:16:44.926990+0000 mon.a (mon.0) 275 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:45 smithi080 bash[35203]: audit 2024-02-17T23:16:44.930374+0000 mon.a (mon.0) 276 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:45 smithi080 bash[35203]: audit 2024-02-17T23:16:44.930903+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:45 smithi080 bash[35203]: audit 2024-02-17T23:16:45.396643+0000 mon.c (mon.1) 8 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/2632773501,v1:172.21.15.5:6819/2632773501]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:16:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:45 smithi080 bash[35203]: audit 2024-02-17T23:16:45.396923+0000 mon.a (mon.0) 278 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:16:46.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[35193]: cluster 2024-02-17T23:16:45.665649+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:46.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[35193]: audit 2024-02-17T23:16:45.931585+0000 mon.a (mon.0) 279 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-17T23:16:46.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[35193]: cluster 2024-02-17T23:16:45.931643+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-17T23:16:46.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[35193]: audit 2024-02-17T23:16:45.931772+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:46.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[35193]: audit 2024-02-17T23:16:45.932126+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/2632773501,v1:172.21.15.5:6819/2632773501]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:46.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[35193]: audit 2024-02-17T23:16:45.932396+0000 mon.a (mon.0) 282 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:46.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[38535]: cluster 2024-02-17T23:16:45.665649+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:46.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[38535]: audit 2024-02-17T23:16:45.931585+0000 mon.a (mon.0) 279 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-17T23:16:46.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[38535]: cluster 2024-02-17T23:16:45.931643+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-17T23:16:46.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[38535]: audit 2024-02-17T23:16:45.931772+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:46.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[38535]: audit 2024-02-17T23:16:45.932126+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/2632773501,v1:172.21.15.5:6819/2632773501]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:46.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[38535]: audit 2024-02-17T23:16:45.932396+0000 mon.a (mon.0) 282 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:47.132 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[43923]: debug 2024-02-17T23:16:46.935+0000 7f1483b65700 -1 osd.2 0 waiting for initial osdmap 2024-02-17T23:16:47.133 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:16:46 smithi005 bash[43923]: debug 2024-02-17T23:16:46.938+0000 7f148ed81700 -1 osd.2 20 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-17T23:16:47.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:46 smithi080 bash[35203]: cluster 2024-02-17T23:16:45.665649+0000 mgr.y (mgr.14140) 85 : cluster [DBG] pgmap v77: 1 pgs: 1 active+undersized+degraded; 0 B data, 320 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:47.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:46 smithi080 bash[35203]: audit 2024-02-17T23:16:45.931585+0000 mon.a (mon.0) 279 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-17T23:16:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:46 smithi080 bash[35203]: cluster 2024-02-17T23:16:45.931643+0000 mon.a (mon.0) 280 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2024-02-17T23:16:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:46 smithi080 bash[35203]: audit 2024-02-17T23:16:45.931772+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:46 smithi080 bash[35203]: audit 2024-02-17T23:16:45.932126+0000 mon.c (mon.1) 9 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/2632773501,v1:172.21.15.5:6819/2632773501]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:46 smithi080 bash[35203]: audit 2024-02-17T23:16:45.932396+0000 mon.a (mon.0) 282 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:16:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[38535]: cluster 2024-02-17T23:16:46.426731+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:16:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[38535]: cluster 2024-02-17T23:16:46.426806+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:16:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[38535]: audit 2024-02-17T23:16:46.933397+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:16:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[38535]: cluster 2024-02-17T23:16:46.933437+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-17T23:16:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[38535]: audit 2024-02-17T23:16:46.933593+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[38535]: cluster 2024-02-17T23:16:47.665938+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v80: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:48.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[35193]: cluster 2024-02-17T23:16:46.426731+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:16:48.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[35193]: cluster 2024-02-17T23:16:46.426806+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:16:48.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[35193]: audit 2024-02-17T23:16:46.933397+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:16:48.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[35193]: cluster 2024-02-17T23:16:46.933437+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-17T23:16:48.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[35193]: audit 2024-02-17T23:16:46.933593+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:48.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:47 smithi005 bash[35193]: cluster 2024-02-17T23:16:47.665938+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v80: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:48.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:47 smithi080 bash[35203]: cluster 2024-02-17T23:16:46.426731+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:16:48.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:47 smithi080 bash[35203]: cluster 2024-02-17T23:16:46.426806+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:16:48.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:47 smithi080 bash[35203]: audit 2024-02-17T23:16:46.933397+0000 mon.a (mon.0) 283 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:16:48.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:47 smithi080 bash[35203]: cluster 2024-02-17T23:16:46.933437+0000 mon.a (mon.0) 284 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2024-02-17T23:16:48.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:47 smithi080 bash[35203]: audit 2024-02-17T23:16:46.933593+0000 mon.a (mon.0) 285 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:48.394 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:47 smithi080 bash[35203]: cluster 2024-02-17T23:16:47.665938+0000 mgr.y (mgr.14140) 86 : cluster [DBG] pgmap v80: 1 pgs: 1 active+undersized+degraded; 0 B data, 328 KiB used, 177 GiB / 179 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:49.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:48 smithi005 bash[35193]: cluster 2024-02-17T23:16:47.939020+0000 mon.a (mon.0) 286 : cluster [INF] osd.2 [v2:172.21.15.5:6818/2632773501,v1:172.21.15.5:6819/2632773501] boot 2024-02-17T23:16:49.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:48 smithi005 bash[35193]: cluster 2024-02-17T23:16:47.939054+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-17T23:16:49.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:48 smithi005 bash[35193]: audit 2024-02-17T23:16:47.939369+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:49.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:48 smithi005 bash[35193]: audit 2024-02-17T23:16:48.928296+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:48 smithi005 bash[38535]: cluster 2024-02-17T23:16:47.939020+0000 mon.a (mon.0) 286 : cluster [INF] osd.2 [v2:172.21.15.5:6818/2632773501,v1:172.21.15.5:6819/2632773501] boot 2024-02-17T23:16:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:48 smithi005 bash[38535]: cluster 2024-02-17T23:16:47.939054+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-17T23:16:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:48 smithi005 bash[38535]: audit 2024-02-17T23:16:47.939369+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:49.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:48 smithi005 bash[38535]: audit 2024-02-17T23:16:48.928296+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:49.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:48 smithi080 bash[35203]: cluster 2024-02-17T23:16:47.939020+0000 mon.a (mon.0) 286 : cluster [INF] osd.2 [v2:172.21.15.5:6818/2632773501,v1:172.21.15.5:6819/2632773501] boot 2024-02-17T23:16:49.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:48 smithi080 bash[35203]: cluster 2024-02-17T23:16:47.939054+0000 mon.a (mon.0) 287 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-02-17T23:16:49.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:48 smithi080 bash[35203]: audit 2024-02-17T23:16:47.939369+0000 mon.a (mon.0) 288 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:16:49.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:48 smithi080 bash[35203]: audit 2024-02-17T23:16:48.928296+0000 mon.a (mon.0) 289 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:16:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-17T23:16:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-17T23:16:49.420 INFO:teuthology.orchestra.run.smithi005.stderr: stderr: 10+0 records in 2024-02-17T23:16:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:10+0 records out 2024-02-17T23:16:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00805574 s, 1.3 GB/s 2024-02-17T23:16:49.420 INFO:teuthology.orchestra.run.smithi005.stderr:--> Zapping successful for: 2024-02-17T23:16:50.055 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:49 smithi005 bash[35193]: cluster 2024-02-17T23:16:48.943359+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-17T23:16:50.056 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:49 smithi005 bash[38535]: cluster 2024-02-17T23:16:48.943359+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-17T23:16:50.056 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:49 smithi005 bash[35193]: audit 2024-02-17T23:16:49.148809+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:50.057 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:49 smithi005 bash[35193]: audit 2024-02-17T23:16:49.152227+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:50.057 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:49 smithi005 bash[35193]: cluster 2024-02-17T23:16:49.666165+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:50.057 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:49 smithi005 bash[38535]: audit 2024-02-17T23:16:49.148809+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:50.057 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:49 smithi005 bash[38535]: audit 2024-02-17T23:16:49.152227+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:50.057 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:49 smithi005 bash[38535]: cluster 2024-02-17T23:16:49.666165+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:50.067 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi005:vg_nvme/lv_1 2024-02-17T23:16:50.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:49 smithi080 bash[35203]: cluster 2024-02-17T23:16:48.943359+0000 mon.a (mon.0) 290 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-02-17T23:16:50.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:49 smithi080 bash[35203]: audit 2024-02-17T23:16:49.148809+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:16:50.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:49 smithi080 bash[35203]: audit 2024-02-17T23:16:49.152227+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}}, \"last_daemon_update\": \"2024-02-17T23:16:44.926315\", \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:16:50.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:49 smithi080 bash[35203]: cluster 2024-02-17T23:16:49.666165+0000 mgr.y (mgr.14140) 87 : cluster [DBG] pgmap v83: 1 pgs: 1 active+undersized+degraded; 0 B data, 512 KiB used, 265 GiB / 268 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:16:51.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:51 smithi005 bash[35193]: cluster 2024-02-17T23:16:51.717191+0000 mon.a (mon.0) 293 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-17T23:16:51.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:51 smithi005 bash[35193]: cluster 2024-02-17T23:16:51.717255+0000 mon.a (mon.0) 294 : cluster [INF] Cluster is now healthy 2024-02-17T23:16:51.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:51 smithi005 bash[38535]: cluster 2024-02-17T23:16:51.717191+0000 mon.a (mon.0) 293 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-17T23:16:51.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:51 smithi005 bash[38535]: cluster 2024-02-17T23:16:51.717255+0000 mon.a (mon.0) 294 : cluster [INF] Cluster is now healthy 2024-02-17T23:16:52.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:51 smithi080 bash[35203]: cluster 2024-02-17T23:16:51.717191+0000 mon.a (mon.0) 293 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-17T23:16:52.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:51 smithi080 bash[35203]: cluster 2024-02-17T23:16:51.717255+0000 mon.a (mon.0) 294 : cluster [INF] Cluster is now healthy 2024-02-17T23:16:53.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:52 smithi005 bash[35193]: cluster 2024-02-17T23:16:51.666396+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 536 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:53.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:52 smithi005 bash[35193]: audit 2024-02-17T23:16:52.053281+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:16:53.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:52 smithi005 bash[35193]: audit 2024-02-17T23:16:52.053881+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:53.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:52 smithi005 bash[35193]: audit 2024-02-17T23:16:52.054661+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:53.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:52 smithi005 bash[38535]: cluster 2024-02-17T23:16:51.666396+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 536 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:53.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:52 smithi005 bash[38535]: audit 2024-02-17T23:16:52.053281+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:16:53.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:52 smithi005 bash[38535]: audit 2024-02-17T23:16:52.053881+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:53.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:52 smithi005 bash[38535]: audit 2024-02-17T23:16:52.054661+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:53.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:52 smithi080 bash[35203]: cluster 2024-02-17T23:16:51.666396+0000 mgr.y (mgr.14140) 88 : cluster [DBG] pgmap v84: 1 pgs: 1 active+clean; 0 B data, 536 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:53.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:52 smithi080 bash[35203]: audit 2024-02-17T23:16:52.053281+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:16:53.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:52 smithi080 bash[35203]: audit 2024-02-17T23:16:52.053881+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:16:53.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:52 smithi080 bash[35203]: audit 2024-02-17T23:16:52.054661+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:53.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:53 smithi005 bash[35193]: audit 2024-02-17T23:16:52.052440+0000 mgr.y (mgr.14140) 89 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:16:53.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:53 smithi005 bash[35193]: cephadm 2024-02-17T23:16:52.053012+0000 mgr.y (mgr.14140) 90 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:16:53.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:53 smithi005 bash[35193]: cluster 2024-02-17T23:16:53.666652+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:53.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:53 smithi005 bash[38535]: audit 2024-02-17T23:16:52.052440+0000 mgr.y (mgr.14140) 89 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:16:53.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:53 smithi005 bash[38535]: cephadm 2024-02-17T23:16:52.053012+0000 mgr.y (mgr.14140) 90 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:16:53.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:53 smithi005 bash[38535]: cluster 2024-02-17T23:16:53.666652+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:54.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:53 smithi080 bash[35203]: audit 2024-02-17T23:16:52.052440+0000 mgr.y (mgr.14140) 89 : audit [DBG] from='client.24196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi005:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:16:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:53 smithi080 bash[35203]: cephadm 2024-02-17T23:16:52.053012+0000 mgr.y (mgr.14140) 90 : cephadm [INF] Applying osd on host smithi005... 2024-02-17T23:16:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:53 smithi080 bash[35203]: cluster 2024-02-17T23:16:53.666652+0000 mgr.y (mgr.14140) 91 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 560 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:54 smithi005 bash[35193]: audit 2024-02-17T23:16:54.631854+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.5:0/4114487326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "090543ef-5784-4b6c-a6b8-456f4c98440c"}]: dispatch 2024-02-17T23:16:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:54 smithi005 bash[35193]: audit 2024-02-17T23:16:54.632133+0000 mon.a (mon.0) 298 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "090543ef-5784-4b6c-a6b8-456f4c98440c"}]: dispatch 2024-02-17T23:16:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:54 smithi005 bash[35193]: audit 2024-02-17T23:16:54.635786+0000 mon.a (mon.0) 299 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "090543ef-5784-4b6c-a6b8-456f4c98440c"}]': finished 2024-02-17T23:16:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:54 smithi005 bash[35193]: cluster 2024-02-17T23:16:54.635830+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-17T23:16:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:54 smithi005 bash[35193]: audit 2024-02-17T23:16:54.635940+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:16:55.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:54 smithi005 bash[38535]: audit 2024-02-17T23:16:54.631854+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.5:0/4114487326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "090543ef-5784-4b6c-a6b8-456f4c98440c"}]: dispatch 2024-02-17T23:16:55.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:54 smithi005 bash[38535]: audit 2024-02-17T23:16:54.632133+0000 mon.a (mon.0) 298 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "090543ef-5784-4b6c-a6b8-456f4c98440c"}]: dispatch 2024-02-17T23:16:55.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:54 smithi005 bash[38535]: audit 2024-02-17T23:16:54.635786+0000 mon.a (mon.0) 299 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "090543ef-5784-4b6c-a6b8-456f4c98440c"}]': finished 2024-02-17T23:16:55.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:54 smithi005 bash[38535]: cluster 2024-02-17T23:16:54.635830+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-17T23:16:55.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:54 smithi005 bash[38535]: audit 2024-02-17T23:16:54.635940+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:16:55.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:54 smithi080 bash[35203]: audit 2024-02-17T23:16:54.631854+0000 mon.c (mon.1) 10 : audit [INF] from='client.? 172.21.15.5:0/4114487326' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "090543ef-5784-4b6c-a6b8-456f4c98440c"}]: dispatch 2024-02-17T23:16:55.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:54 smithi080 bash[35203]: audit 2024-02-17T23:16:54.632133+0000 mon.a (mon.0) 298 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "090543ef-5784-4b6c-a6b8-456f4c98440c"}]: dispatch 2024-02-17T23:16:55.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:54 smithi080 bash[35203]: audit 2024-02-17T23:16:54.635786+0000 mon.a (mon.0) 299 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "090543ef-5784-4b6c-a6b8-456f4c98440c"}]': finished 2024-02-17T23:16:55.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:54 smithi080 bash[35203]: cluster 2024-02-17T23:16:54.635830+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2024-02-17T23:16:55.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:54 smithi080 bash[35203]: audit 2024-02-17T23:16:54.635940+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:16:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:55 smithi005 bash[35193]: audit 2024-02-17T23:16:55.349415+0000 mon.a (mon.0) 302 : audit [DBG] from='client.? 172.21.15.5:0/2768937805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:16:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:55 smithi005 bash[35193]: cluster 2024-02-17T23:16:55.666889+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:55 smithi005 bash[38535]: audit 2024-02-17T23:16:55.349415+0000 mon.a (mon.0) 302 : audit [DBG] from='client.? 172.21.15.5:0/2768937805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:16:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:55 smithi005 bash[38535]: cluster 2024-02-17T23:16:55.666889+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:56.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:55 smithi080 bash[35203]: audit 2024-02-17T23:16:55.349415+0000 mon.a (mon.0) 302 : audit [DBG] from='client.? 172.21.15.5:0/2768937805' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:16:56.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:55 smithi080 bash[35203]: cluster 2024-02-17T23:16:55.666889+0000 mgr.y (mgr.14140) 92 : cluster [DBG] pgmap v87: 1 pgs: 1 active+clean; 0 B data, 576 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:59.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:58 smithi005 bash[35193]: cluster 2024-02-17T23:16:57.667154+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:59.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:16:58 smithi005 bash[35193]: audit 2024-02-17T23:16:57.977251+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:59.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:58 smithi005 bash[38535]: cluster 2024-02-17T23:16:57.667154+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:59.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:16:58 smithi005 bash[38535]: audit 2024-02-17T23:16:57.977251+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:16:59.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:58 smithi080 bash[35203]: cluster 2024-02-17T23:16:57.667154+0000 mgr.y (mgr.14140) 93 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 584 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:16:59.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:16:58 smithi080 bash[35203]: audit 2024-02-17T23:16:57.977251+0000 mon.a (mon.0) 303 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:01.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:00 smithi005 bash[38535]: cluster 2024-02-17T23:16:59.667389+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:01.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:00 smithi005 bash[35193]: cluster 2024-02-17T23:16:59.667389+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:01.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:00 smithi080 bash[35203]: cluster 2024-02-17T23:16:59.667389+0000 mgr.y (mgr.14140) 94 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 592 KiB used, 265 GiB / 268 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:02.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:01 smithi005 bash[38535]: audit 2024-02-17T23:17:01.164278+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-17T23:17:02.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:01 smithi005 bash[38535]: audit 2024-02-17T23:17:01.165102+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:02.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:01 smithi005 bash[38535]: audit 2024-02-17T23:17:01.165997+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-17T23:17:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:01 smithi005 bash[35193]: audit 2024-02-17T23:17:01.164278+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-17T23:17:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:01 smithi005 bash[35193]: audit 2024-02-17T23:17:01.165102+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:01 smithi005 bash[35193]: audit 2024-02-17T23:17:01.165997+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-17T23:17:02.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:01 smithi080 bash[35203]: audit 2024-02-17T23:17:01.164278+0000 mon.a (mon.0) 304 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-17T23:17:02.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:01 smithi080 bash[35203]: audit 2024-02-17T23:17:01.165102+0000 mon.a (mon.0) 305 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:02.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:01 smithi080 bash[35203]: audit 2024-02-17T23:17:01.165997+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2024-02-17T23:17:03.043 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:02 smithi005 bash[35193]: cephadm 2024-02-17T23:17:01.165715+0000 mgr.y (mgr.14140) 95 : cephadm [INF] Deploying daemon osd.3 on smithi005 2024-02-17T23:17:03.043 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:02 smithi005 bash[35193]: cluster 2024-02-17T23:17:01.667635+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:03.043 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:02 smithi005 bash[38535]: cephadm 2024-02-17T23:17:01.165715+0000 mgr.y (mgr.14140) 95 : cephadm [INF] Deploying daemon osd.3 on smithi005 2024-02-17T23:17:03.043 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:02 smithi005 bash[38535]: cluster 2024-02-17T23:17:01.667635+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:03.110 INFO:teuthology.orchestra.run.smithi005.stdout:Created osd(s) 3 on host 'smithi005' 2024-02-17T23:17:03.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:02 smithi080 bash[35203]: cephadm 2024-02-17T23:17:01.165715+0000 mgr.y (mgr.14140) 95 : cephadm [INF] Deploying daemon osd.3 on smithi005 2024-02-17T23:17:03.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:02 smithi080 bash[35203]: cluster 2024-02-17T23:17:01.667635+0000 mgr.y (mgr.14140) 96 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:03 smithi005 bash[35193]: audit 2024-02-17T23:17:03.102279+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:17:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:03 smithi005 bash[35193]: audit 2024-02-17T23:17:03.102692+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:03 smithi005 bash[35193]: audit 2024-02-17T23:17:03.105336+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:17:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:03 smithi005 bash[38535]: audit 2024-02-17T23:17:03.102279+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:17:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:03 smithi005 bash[38535]: audit 2024-02-17T23:17:03.102692+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:03 smithi005 bash[38535]: audit 2024-02-17T23:17:03.105336+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:17:04.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:03 smithi080 bash[35203]: audit 2024-02-17T23:17:03.102279+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:17:04.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:03 smithi080 bash[35203]: audit 2024-02-17T23:17:03.102692+0000 mon.a (mon.0) 308 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:04.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:03 smithi080 bash[35203]: audit 2024-02-17T23:17:03.105336+0000 mon.a (mon.0) 309 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926029\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926116\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926152\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926182\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926212\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:16:44.926242\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_device_update\": \"2024-02-17T23:16:49.147920\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:17:04.227 DEBUG:teuthology.orchestra.run.smithi005:osd.3> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.3.service 2024-02-17T23:17:04.231 INFO:tasks.cephadm:Deploying osd.4 on smithi080 with /dev/vg_nvme/lv_4... 2024-02-17T23:17:04.232 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-02-17T23:17:04.264 INFO:journalctl@ceph.osd.3.smithi005.stdout:-- Logs begin at Sat 2024-02-17 23:05:20 UTC. -- 2024-02-17T23:17:04.849 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:04 smithi080 bash[35203]: cluster 2024-02-17T23:17:03.667859+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:05.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:04 smithi005 bash[35193]: cluster 2024-02-17T23:17:03.667859+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:05.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:04 smithi005 bash[38535]: cluster 2024-02-17T23:17:03.667859+0000 mgr.y (mgr.14140) 97 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:06.357 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-02-17T23:17:06.358 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-02-17T23:17:06.358 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-17T23:17:06.358 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-17T23:17:06.358 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110685 s, 947 MB/s 2024-02-17T23:17:06.358 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-17T23:17:06.876 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:17:06 smithi005 bash[45515]: debug 2024-02-17T23:17:06.607+0000 7f96c2228ec0 -1 Falling back to public interface 2024-02-17T23:17:06.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:06 smithi005 bash[35193]: cluster 2024-02-17T23:17:05.668113+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:06 smithi005 bash[38535]: cluster 2024-02-17T23:17:05.668113+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:06 smithi005 bash[35193]: audit 2024-02-17T23:17:06.451621+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:17:06.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:06 smithi005 bash[38535]: audit 2024-02-17T23:17:06.451621+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:17:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:06 smithi005 bash[35193]: audit 2024-02-17T23:17:06.454447+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:17:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:06 smithi005 bash[35193]: audit 2024-02-17T23:17:06.454930+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:06.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:06 smithi005 bash[38535]: audit 2024-02-17T23:17:06.454447+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:17:06.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:06 smithi005 bash[38535]: audit 2024-02-17T23:17:06.454930+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:06.990 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:06 smithi080 bash[35203]: cluster 2024-02-17T23:17:05.668113+0000 mgr.y (mgr.14140) 98 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:06.990 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:06 smithi080 bash[35203]: audit 2024-02-17T23:17:06.451621+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:17:06.990 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:06 smithi080 bash[35203]: audit 2024-02-17T23:17:06.454447+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:17:06.990 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:06 smithi080 bash[35203]: audit 2024-02-17T23:17:06.454930+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:07.000 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_4 2024-02-17T23:17:07.228 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:17:07 smithi005 bash[45515]: debug 2024-02-17T23:17:07.155+0000 7f96c2228ec0 -1 osd.3 0 log_to_monitors {default=true} 2024-02-17T23:17:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:07 smithi005 bash[35193]: audit 2024-02-17T23:17:07.158439+0000 mon.c (mon.1) 11 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/192017774,v1:172.21.15.5:6827/192017774]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-17T23:17:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:07 smithi005 bash[35193]: audit 2024-02-17T23:17:07.158685+0000 mon.a (mon.0) 313 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-17T23:17:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:07 smithi005 bash[38535]: audit 2024-02-17T23:17:07.158439+0000 mon.c (mon.1) 11 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/192017774,v1:172.21.15.5:6827/192017774]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-17T23:17:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:07 smithi005 bash[38535]: audit 2024-02-17T23:17:07.158685+0000 mon.a (mon.0) 313 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-17T23:17:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:07 smithi080 bash[35203]: audit 2024-02-17T23:17:07.158439+0000 mon.c (mon.1) 11 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/192017774,v1:172.21.15.5:6827/192017774]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-17T23:17:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:07 smithi080 bash[35203]: audit 2024-02-17T23:17:07.158685+0000 mon.a (mon.0) 313 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-17T23:17:09.126 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[45515]: debug 2024-02-17T23:17:08.749+0000 7f96a6fd5700 -1 osd.3 0 waiting for initial osdmap 2024-02-17T23:17:09.126 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[45515]: debug 2024-02-17T23:17:08.753+0000 7f96b21f1700 -1 osd.3 25 set_numa_affinity unable to identify public interface 'ens1f0' numa node: (0) Success 2024-02-17T23:17:09.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[35193]: cluster 2024-02-17T23:17:07.668329+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[35193]: audit 2024-02-17T23:17:07.744446+0000 mon.a (mon.0) 314 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[35193]: cluster 2024-02-17T23:17:07.744479+0000 mon.a (mon.0) 315 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[35193]: audit 2024-02-17T23:17:07.744604+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[35193]: audit 2024-02-17T23:17:07.744953+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/192017774,v1:172.21.15.5:6827/192017774]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[35193]: audit 2024-02-17T23:17:07.745203+0000 mon.a (mon.0) 317 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[35193]: cluster 2024-02-17T23:17:08.149955+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[35193]: cluster 2024-02-17T23:17:08.150005+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[38535]: cluster 2024-02-17T23:17:07.668329+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[38535]: audit 2024-02-17T23:17:07.744446+0000 mon.a (mon.0) 314 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[38535]: cluster 2024-02-17T23:17:07.744479+0000 mon.a (mon.0) 315 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-17T23:17:09.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[38535]: audit 2024-02-17T23:17:07.744604+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:17:09.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[38535]: audit 2024-02-17T23:17:07.744953+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/192017774,v1:172.21.15.5:6827/192017774]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:17:09.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[38535]: audit 2024-02-17T23:17:07.745203+0000 mon.a (mon.0) 317 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:17:09.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[38535]: cluster 2024-02-17T23:17:08.149955+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:17:09.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:08 smithi005 bash[38535]: cluster 2024-02-17T23:17:08.150005+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:17:09.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:08 smithi080 bash[35203]: cluster 2024-02-17T23:17:07.668329+0000 mgr.y (mgr.14140) 99 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 600 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:08 smithi080 bash[35203]: audit 2024-02-17T23:17:07.744446+0000 mon.a (mon.0) 314 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-17T23:17:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:08 smithi080 bash[35203]: cluster 2024-02-17T23:17:07.744479+0000 mon.a (mon.0) 315 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2024-02-17T23:17:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:08 smithi080 bash[35203]: audit 2024-02-17T23:17:07.744604+0000 mon.a (mon.0) 316 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:17:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:08 smithi080 bash[35203]: audit 2024-02-17T23:17:07.744953+0000 mon.c (mon.1) 12 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/192017774,v1:172.21.15.5:6827/192017774]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:17:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:08 smithi080 bash[35203]: audit 2024-02-17T23:17:07.745203+0000 mon.a (mon.0) 317 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:17:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:08 smithi080 bash[35203]: cluster 2024-02-17T23:17:08.149955+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:17:09.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:08 smithi080 bash[35203]: cluster 2024-02-17T23:17:08.150005+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:17:09.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[35193]: audit 2024-02-17T23:17:08.745910+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:17:09.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[35193]: cluster 2024-02-17T23:17:08.745962+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-17T23:17:09.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[35193]: audit 2024-02-17T23:17:08.746484+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:17:09.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[35193]: audit 2024-02-17T23:17:09.138679+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:17:09.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[35193]: audit 2024-02-17T23:17:09.139334+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:09.831 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[35193]: audit 2024-02-17T23:17:09.140165+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:09.831 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[38535]: audit 2024-02-17T23:17:08.745910+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:17:09.831 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[38535]: cluster 2024-02-17T23:17:08.745962+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-17T23:17:09.832 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[38535]: audit 2024-02-17T23:17:08.746484+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:17:09.832 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[38535]: audit 2024-02-17T23:17:09.138679+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:17:09.832 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[38535]: audit 2024-02-17T23:17:09.139334+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:09.832 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:09 smithi005 bash[38535]: audit 2024-02-17T23:17:09.140165+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:09.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:09 smithi080 bash[35203]: audit 2024-02-17T23:17:08.745910+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]': finished 2024-02-17T23:17:09.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:09 smithi080 bash[35203]: cluster 2024-02-17T23:17:08.745962+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2024-02-17T23:17:09.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:09 smithi080 bash[35203]: audit 2024-02-17T23:17:08.746484+0000 mon.a (mon.0) 320 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:17:09.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:09 smithi080 bash[35203]: audit 2024-02-17T23:17:09.138679+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:17:09.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:09 smithi080 bash[35203]: audit 2024-02-17T23:17:09.139334+0000 mon.a (mon.0) 322 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:09.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:09 smithi080 bash[35203]: audit 2024-02-17T23:17:09.140165+0000 mon.a (mon.0) 323 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[35193]: audit 2024-02-17T23:17:09.137674+0000 mgr.y (mgr.14140) 100 : audit [DBG] from='client.34193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:17:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[35193]: cephadm 2024-02-17T23:17:09.138418+0000 mgr.y (mgr.14140) 101 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:17:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[35193]: cluster 2024-02-17T23:17:09.668573+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[35193]: cluster 2024-02-17T23:17:09.754708+0000 mon.a (mon.0) 324 : cluster [INF] osd.3 [v2:172.21.15.5:6826/192017774,v1:172.21.15.5:6827/192017774] boot 2024-02-17T23:17:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[35193]: cluster 2024-02-17T23:17:09.754743+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-17T23:17:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[35193]: audit 2024-02-17T23:17:09.754997+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:17:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[35193]: audit 2024-02-17T23:17:09.842159+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[38535]: audit 2024-02-17T23:17:09.137674+0000 mgr.y (mgr.14140) 100 : audit [DBG] from='client.34193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:17:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[38535]: cephadm 2024-02-17T23:17:09.138418+0000 mgr.y (mgr.14140) 101 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:17:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[38535]: cluster 2024-02-17T23:17:09.668573+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[38535]: cluster 2024-02-17T23:17:09.754708+0000 mon.a (mon.0) 324 : cluster [INF] osd.3 [v2:172.21.15.5:6826/192017774,v1:172.21.15.5:6827/192017774] boot 2024-02-17T23:17:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[38535]: cluster 2024-02-17T23:17:09.754743+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-17T23:17:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[38535]: audit 2024-02-17T23:17:09.754997+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:17:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[38535]: audit 2024-02-17T23:17:09.842159+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:11.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[35193]: audit 2024-02-17T23:17:10.057364+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:17:11.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[35193]: audit 2024-02-17T23:17:10.059908+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:17:11.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[38535]: audit 2024-02-17T23:17:10.057364+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:17:11.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:10 smithi005 bash[38535]: audit 2024-02-17T23:17:10.059908+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:17:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:10 smithi080 bash[35203]: audit 2024-02-17T23:17:09.137674+0000 mgr.y (mgr.14140) 100 : audit [DBG] from='client.34193 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:17:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:10 smithi080 bash[35203]: cephadm 2024-02-17T23:17:09.138418+0000 mgr.y (mgr.14140) 101 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:17:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:10 smithi080 bash[35203]: cluster 2024-02-17T23:17:09.668573+0000 mgr.y (mgr.14140) 102 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 608 KiB used, 265 GiB / 268 GiB avail 2024-02-17T23:17:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:10 smithi080 bash[35203]: cluster 2024-02-17T23:17:09.754708+0000 mon.a (mon.0) 324 : cluster [INF] osd.3 [v2:172.21.15.5:6826/192017774,v1:172.21.15.5:6827/192017774] boot 2024-02-17T23:17:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:10 smithi080 bash[35203]: cluster 2024-02-17T23:17:09.754743+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-02-17T23:17:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:10 smithi080 bash[35203]: audit 2024-02-17T23:17:09.754997+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:17:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:10 smithi080 bash[35203]: audit 2024-02-17T23:17:09.842159+0000 mon.a (mon.0) 327 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:10 smithi080 bash[35203]: audit 2024-02-17T23:17:10.057364+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:17:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:10 smithi080 bash[35203]: audit 2024-02-17T23:17:10.059908+0000 mon.a (mon.0) 329 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}}, \"last_daemon_update\": \"2024-02-17T23:17:06.450931\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:17:12.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[35193]: cluster 2024-02-17T23:17:11.062316+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-17T23:17:12.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[35193]: audit 2024-02-17T23:17:11.386714+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.80:0/578540696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1155a36f-e150-4d31-aac3-2ac9081cd6aa"}]: dispatch 2024-02-17T23:17:12.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[35193]: audit 2024-02-17T23:17:11.387129+0000 mon.a (mon.0) 331 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1155a36f-e150-4d31-aac3-2ac9081cd6aa"}]: dispatch 2024-02-17T23:17:12.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[35193]: audit 2024-02-17T23:17:11.391531+0000 mon.a (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1155a36f-e150-4d31-aac3-2ac9081cd6aa"}]': finished 2024-02-17T23:17:12.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[35193]: cluster 2024-02-17T23:17:11.391589+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-17T23:17:12.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[35193]: audit 2024-02-17T23:17:11.391718+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:12.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[35193]: cluster 2024-02-17T23:17:11.668836+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 848 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:12.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[38535]: cluster 2024-02-17T23:17:11.062316+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-17T23:17:12.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[38535]: audit 2024-02-17T23:17:11.386714+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.80:0/578540696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1155a36f-e150-4d31-aac3-2ac9081cd6aa"}]: dispatch 2024-02-17T23:17:12.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[38535]: audit 2024-02-17T23:17:11.387129+0000 mon.a (mon.0) 331 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1155a36f-e150-4d31-aac3-2ac9081cd6aa"}]: dispatch 2024-02-17T23:17:12.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[38535]: audit 2024-02-17T23:17:11.391531+0000 mon.a (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1155a36f-e150-4d31-aac3-2ac9081cd6aa"}]': finished 2024-02-17T23:17:12.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[38535]: cluster 2024-02-17T23:17:11.391589+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-17T23:17:12.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[38535]: audit 2024-02-17T23:17:11.391718+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:12.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:12 smithi005 bash[38535]: cluster 2024-02-17T23:17:11.668836+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 848 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:12.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:12 smithi080 bash[35203]: cluster 2024-02-17T23:17:11.062316+0000 mon.a (mon.0) 330 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-02-17T23:17:12.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:12 smithi080 bash[35203]: audit 2024-02-17T23:17:11.386714+0000 mon.b (mon.2) 5 : audit [INF] from='client.? 172.21.15.80:0/578540696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1155a36f-e150-4d31-aac3-2ac9081cd6aa"}]: dispatch 2024-02-17T23:17:12.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:12 smithi080 bash[35203]: audit 2024-02-17T23:17:11.387129+0000 mon.a (mon.0) 331 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1155a36f-e150-4d31-aac3-2ac9081cd6aa"}]: dispatch 2024-02-17T23:17:12.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:12 smithi080 bash[35203]: audit 2024-02-17T23:17:11.391531+0000 mon.a (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1155a36f-e150-4d31-aac3-2ac9081cd6aa"}]': finished 2024-02-17T23:17:12.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:12 smithi080 bash[35203]: cluster 2024-02-17T23:17:11.391589+0000 mon.a (mon.0) 333 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2024-02-17T23:17:12.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:12 smithi080 bash[35203]: audit 2024-02-17T23:17:11.391718+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:12.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:12 smithi080 bash[35203]: cluster 2024-02-17T23:17:11.668836+0000 mgr.y (mgr.14140) 103 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 848 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:13.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:13 smithi005 bash[35193]: audit 2024-02-17T23:17:12.131119+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.80:0/262161148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:17:13.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:13 smithi005 bash[38535]: audit 2024-02-17T23:17:12.131119+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.80:0/262161148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:17:13.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:13 smithi080 bash[35203]: audit 2024-02-17T23:17:12.131119+0000 mon.b (mon.2) 6 : audit [DBG] from='client.? 172.21.15.80:0/262161148' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:17:15.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:14 smithi005 bash[35193]: cluster 2024-02-17T23:17:13.669126+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 888 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:15.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:14 smithi005 bash[38535]: cluster 2024-02-17T23:17:13.669126+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 888 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:15.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:14 smithi080 bash[35203]: cluster 2024-02-17T23:17:13.669126+0000 mgr.y (mgr.14140) 104 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 888 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:16.071 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:15 smithi080 bash[35203]: audit 2024-02-17T23:17:14.767389+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:15 smithi005 bash[35193]: audit 2024-02-17T23:17:14.767389+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:15 smithi005 bash[38535]: audit 2024-02-17T23:17:14.767389+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:17.112 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:16 smithi080 bash[35203]: cluster 2024-02-17T23:17:15.669422+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:17.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:16 smithi005 bash[35193]: cluster 2024-02-17T23:17:15.669422+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:17.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:16 smithi005 bash[38535]: cluster 2024-02-17T23:17:15.669422+0000 mgr.y (mgr.14140) 105 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 944 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:17.968 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:17 smithi080 bash[35203]: audit 2024-02-17T23:17:17.345592+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-17T23:17:17.968 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:17 smithi080 bash[35203]: audit 2024-02-17T23:17:17.346375+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:17.968 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:17 smithi080 bash[35203]: audit 2024-02-17T23:17:17.347227+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-17T23:17:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:17 smithi005 bash[35193]: audit 2024-02-17T23:17:17.345592+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-17T23:17:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:17 smithi005 bash[35193]: audit 2024-02-17T23:17:17.346375+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:17 smithi005 bash[35193]: audit 2024-02-17T23:17:17.347227+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-17T23:17:18.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:17 smithi005 bash[38535]: audit 2024-02-17T23:17:17.345592+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-17T23:17:18.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:17 smithi005 bash[38535]: audit 2024-02-17T23:17:17.346375+0000 mon.a (mon.0) 337 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:18.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:17 smithi005 bash[38535]: audit 2024-02-17T23:17:17.347227+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2024-02-17T23:17:18.724 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:18 smithi080 bash[35203]: cephadm 2024-02-17T23:17:17.346931+0000 mgr.y (mgr.14140) 106 : cephadm [INF] Deploying daemon osd.4 on smithi080 2024-02-17T23:17:18.725 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:18 smithi080 bash[35203]: cluster 2024-02-17T23:17:17.669713+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:19.003 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 4 on host 'smithi080' 2024-02-17T23:17:19.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:18 smithi005 bash[35193]: cephadm 2024-02-17T23:17:17.346931+0000 mgr.y (mgr.14140) 106 : cephadm [INF] Deploying daemon osd.4 on smithi080 2024-02-17T23:17:19.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:18 smithi005 bash[35193]: cluster 2024-02-17T23:17:17.669713+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:19.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:18 smithi005 bash[38535]: cephadm 2024-02-17T23:17:17.346931+0000 mgr.y (mgr.14140) 106 : cephadm [INF] Deploying daemon osd.4 on smithi080 2024-02-17T23:17:19.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:18 smithi005 bash[38535]: cluster 2024-02-17T23:17:17.669713+0000 mgr.y (mgr.14140) 107 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:19.878 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:19 smithi080 bash[35203]: audit 2024-02-17T23:17:18.996130+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:19.879 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:19 smithi080 bash[35203]: audit 2024-02-17T23:17:18.996598+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:19.879 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:19 smithi080 bash[35203]: audit 2024-02-17T23:17:18.999630+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:19.893 DEBUG:teuthology.orchestra.run.smithi080:osd.4> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.4.service 2024-02-17T23:17:19.897 INFO:tasks.cephadm:Deploying osd.5 on smithi080 with /dev/vg_nvme/lv_3... 2024-02-17T23:17:19.898 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-02-17T23:17:19.928 INFO:journalctl@ceph.osd.4.smithi080.stdout:-- Logs begin at Sat 2024-02-17 23:05:17 UTC. -- 2024-02-17T23:17:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:19 smithi005 bash[35193]: audit 2024-02-17T23:17:18.996130+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:19 smithi005 bash[35193]: audit 2024-02-17T23:17:18.996598+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:19 smithi005 bash[35193]: audit 2024-02-17T23:17:18.999630+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:20.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:19 smithi005 bash[38535]: audit 2024-02-17T23:17:18.996130+0000 mon.a (mon.0) 339 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:20.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:19 smithi005 bash[38535]: audit 2024-02-17T23:17:18.996598+0000 mon.a (mon.0) 340 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:20.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:19 smithi005 bash[38535]: audit 2024-02-17T23:17:18.999630+0000 mon.a (mon.0) 341 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396738\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:15:44.396819\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_device_update\": \"2024-02-17T23:14:58.151227\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:20.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:20 smithi080 bash[37405]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-17T23:17:20.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:20 smithi080 bash[37405]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-02-17T23:17:20.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:20 smithi080 bash[37405]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2024-02-17T23:17:20.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:20 smithi080 bash[37405]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-02-17T23:17:20.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:20 smithi080 bash[37405]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-17T23:17:20.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:20 smithi080 bash[37405]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-17T23:17:20.641 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:20 smithi080 bash[37405]: --> ceph-volume lvm activate successful for osd ID: 4 2024-02-17T23:17:21.108 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:20 smithi080 bash[35203]: cluster 2024-02-17T23:17:19.670025+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:21.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:20 smithi005 bash[35193]: cluster 2024-02-17T23:17:19.670025+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:21.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:20 smithi005 bash[38535]: cluster 2024-02-17T23:17:19.670025+0000 mgr.y (mgr.14140) 108 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-02-17T23:17:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-02-17T23:17:22.374 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-17T23:17:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-17T23:17:22.374 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0111312 s, 942 MB/s 2024-02-17T23:17:22.374 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-17T23:17:23.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:22 smithi005 bash[35193]: cluster 2024-02-17T23:17:21.670356+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:23.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:22 smithi005 bash[38535]: cluster 2024-02-17T23:17:21.670356+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:23.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:22 smithi080 bash[35203]: cluster 2024-02-17T23:17:21.670356+0000 mgr.y (mgr.14140) 109 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:24.099 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_3 2024-02-17T23:17:24.329 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:24 smithi080 bash[37749]: debug 2024-02-17T23:17:24.066+0000 7ff80f856ec0 -1 Falling back to public interface 2024-02-17T23:17:24.890 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:24 smithi080 bash[37749]: debug 2024-02-17T23:17:24.624+0000 7ff80f856ec0 -1 osd.4 0 log_to_monitors {default=true} 2024-02-17T23:17:24.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:24 smithi080 bash[35203]: cluster 2024-02-17T23:17:23.670660+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:24.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:24 smithi080 bash[35203]: audit 2024-02-17T23:17:23.671233+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:24.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:24 smithi080 bash[35203]: audit 2024-02-17T23:17:23.674743+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:24.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:24 smithi080 bash[35203]: audit 2024-02-17T23:17:23.675479+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:24.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:24 smithi080 bash[35203]: audit 2024-02-17T23:17:24.627086+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/3612340780,v1:172.21.15.80:6801/3612340780]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:17:24.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:24 smithi080 bash[35203]: audit 2024-02-17T23:17:24.627401+0000 mon.a (mon.0) 345 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:17:25.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[38535]: cluster 2024-02-17T23:17:23.670660+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:25.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[35193]: cluster 2024-02-17T23:17:23.670660+0000 mgr.y (mgr.14140) 110 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:25.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[38535]: audit 2024-02-17T23:17:23.671233+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:25.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[38535]: audit 2024-02-17T23:17:23.674743+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:25.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[38535]: audit 2024-02-17T23:17:23.675479+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:25.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[38535]: audit 2024-02-17T23:17:24.627086+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/3612340780,v1:172.21.15.80:6801/3612340780]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:17:25.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[38535]: audit 2024-02-17T23:17:24.627401+0000 mon.a (mon.0) 345 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:17:25.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[35193]: audit 2024-02-17T23:17:23.671233+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:25.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[35193]: audit 2024-02-17T23:17:23.674743+0000 mon.a (mon.0) 343 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"Insufficient space (<5GB) on vgs\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:25.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[35193]: audit 2024-02-17T23:17:23.675479+0000 mon.a (mon.0) 344 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:25.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[35193]: audit 2024-02-17T23:17:24.627086+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/3612340780,v1:172.21.15.80:6801/3612340780]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:17:25.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:24 smithi005 bash[35193]: audit 2024-02-17T23:17:24.627401+0000 mon.a (mon.0) 345 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:17:25.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:25 smithi080 bash[35203]: audit 2024-02-17T23:17:24.675902+0000 mon.a (mon.0) 346 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-17T23:17:25.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:25 smithi080 bash[35203]: cluster 2024-02-17T23:17:24.675968+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-17T23:17:25.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:25 smithi080 bash[35203]: audit 2024-02-17T23:17:24.676150+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:25.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:25 smithi080 bash[35203]: audit 2024-02-17T23:17:24.680712+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/3612340780,v1:172.21.15.80:6801/3612340780]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:25.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:25 smithi080 bash[35203]: audit 2024-02-17T23:17:24.681097+0000 mon.a (mon.0) 349 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:25.890 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:25 smithi080 bash[37749]: debug 2024-02-17T23:17:25.687+0000 7ff7f4603700 -1 osd.4 0 waiting for initial osdmap 2024-02-17T23:17:25.890 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:17:25 smithi080 bash[37749]: debug 2024-02-17T23:17:25.693+0000 7ff7ff81f700 -1 osd.4 30 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-17T23:17:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:25 smithi005 bash[35193]: audit 2024-02-17T23:17:24.675902+0000 mon.a (mon.0) 346 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-17T23:17:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:25 smithi005 bash[35193]: cluster 2024-02-17T23:17:24.675968+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-17T23:17:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:25 smithi005 bash[35193]: audit 2024-02-17T23:17:24.676150+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:25 smithi005 bash[35193]: audit 2024-02-17T23:17:24.680712+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/3612340780,v1:172.21.15.80:6801/3612340780]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:25 smithi005 bash[35193]: audit 2024-02-17T23:17:24.681097+0000 mon.a (mon.0) 349 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:26.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:25 smithi005 bash[38535]: audit 2024-02-17T23:17:24.675902+0000 mon.a (mon.0) 346 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-17T23:17:26.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:25 smithi005 bash[38535]: cluster 2024-02-17T23:17:24.675968+0000 mon.a (mon.0) 347 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2024-02-17T23:17:26.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:25 smithi005 bash[38535]: audit 2024-02-17T23:17:24.676150+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:26.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:25 smithi005 bash[38535]: audit 2024-02-17T23:17:24.680712+0000 mon.b (mon.2) 8 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/3612340780,v1:172.21.15.80:6801/3612340780]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:26.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:25 smithi005 bash[38535]: audit 2024-02-17T23:17:24.681097+0000 mon.a (mon.0) 349 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:26.733 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:26 smithi080 bash[35203]: cluster 2024-02-17T23:17:25.635827+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:17:26.733 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:26 smithi080 bash[35203]: cluster 2024-02-17T23:17:25.635881+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:17:26.733 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:26 smithi080 bash[35203]: cluster 2024-02-17T23:17:25.670970+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:26.733 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:26 smithi080 bash[35203]: audit 2024-02-17T23:17:25.681740+0000 mon.a (mon.0) 350 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:17:26.733 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:26 smithi080 bash[35203]: cluster 2024-02-17T23:17:25.681806+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-17T23:17:26.733 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:26 smithi080 bash[35203]: audit 2024-02-17T23:17:25.682241+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[35193]: cluster 2024-02-17T23:17:25.635827+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:17:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[35193]: cluster 2024-02-17T23:17:25.635881+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:17:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[35193]: cluster 2024-02-17T23:17:25.670970+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[35193]: audit 2024-02-17T23:17:25.681740+0000 mon.a (mon.0) 350 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:17:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[35193]: cluster 2024-02-17T23:17:25.681806+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-17T23:17:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[35193]: audit 2024-02-17T23:17:25.682241+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:27.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[38535]: cluster 2024-02-17T23:17:25.635827+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:17:27.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[38535]: cluster 2024-02-17T23:17:25.635881+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:17:27.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[38535]: cluster 2024-02-17T23:17:25.670970+0000 mgr.y (mgr.14140) 111 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 960 KiB used, 354 GiB / 358 GiB avail 2024-02-17T23:17:27.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[38535]: audit 2024-02-17T23:17:25.681740+0000 mon.a (mon.0) 350 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:17:27.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[38535]: cluster 2024-02-17T23:17:25.681806+0000 mon.a (mon.0) 351 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2024-02-17T23:17:27.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:26 smithi005 bash[38535]: audit 2024-02-17T23:17:25.682241+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:27.865 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:27 smithi080 bash[35203]: cluster 2024-02-17T23:17:26.683032+0000 mon.a (mon.0) 353 : cluster [INF] osd.4 [v2:172.21.15.80:6800/3612340780,v1:172.21.15.80:6801/3612340780] boot 2024-02-17T23:17:27.865 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:27 smithi080 bash[35203]: cluster 2024-02-17T23:17:26.683095+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-17T23:17:27.865 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:27 smithi080 bash[35203]: audit 2024-02-17T23:17:26.683864+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:27.865 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:27 smithi080 bash[35203]: audit 2024-02-17T23:17:27.148915+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:17:27.865 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:27 smithi080 bash[35203]: audit 2024-02-17T23:17:27.149706+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:27.865 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:27 smithi080 bash[35203]: audit 2024-02-17T23:17:27.150875+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:27.865 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:27 smithi080 bash[35203]: cluster 2024-02-17T23:17:27.684313+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-17T23:17:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[35193]: cluster 2024-02-17T23:17:26.683032+0000 mon.a (mon.0) 353 : cluster [INF] osd.4 [v2:172.21.15.80:6800/3612340780,v1:172.21.15.80:6801/3612340780] boot 2024-02-17T23:17:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[35193]: cluster 2024-02-17T23:17:26.683095+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-17T23:17:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[35193]: audit 2024-02-17T23:17:26.683864+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[35193]: audit 2024-02-17T23:17:27.148915+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:17:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[35193]: audit 2024-02-17T23:17:27.149706+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[35193]: audit 2024-02-17T23:17:27.150875+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[35193]: cluster 2024-02-17T23:17:27.684313+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-17T23:17:28.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[38535]: cluster 2024-02-17T23:17:26.683032+0000 mon.a (mon.0) 353 : cluster [INF] osd.4 [v2:172.21.15.80:6800/3612340780,v1:172.21.15.80:6801/3612340780] boot 2024-02-17T23:17:28.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[38535]: cluster 2024-02-17T23:17:26.683095+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2024-02-17T23:17:28.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[38535]: audit 2024-02-17T23:17:26.683864+0000 mon.a (mon.0) 355 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:17:28.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[38535]: audit 2024-02-17T23:17:27.148915+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:17:28.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[38535]: audit 2024-02-17T23:17:27.149706+0000 mon.a (mon.0) 357 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:28.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[38535]: audit 2024-02-17T23:17:27.150875+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:28.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:27 smithi005 bash[38535]: cluster 2024-02-17T23:17:27.684313+0000 mon.a (mon.0) 359 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-02-17T23:17:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:28 smithi005 bash[35193]: audit 2024-02-17T23:17:27.147850+0000 mgr.y (mgr.14140) 112 : audit [DBG] from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:17:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:28 smithi005 bash[35193]: cephadm 2024-02-17T23:17:27.148621+0000 mgr.y (mgr.14140) 113 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:17:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:28 smithi005 bash[35193]: cluster 2024-02-17T23:17:27.671232+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:29.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:28 smithi005 bash[38535]: audit 2024-02-17T23:17:27.147850+0000 mgr.y (mgr.14140) 112 : audit [DBG] from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:17:29.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:28 smithi005 bash[38535]: cephadm 2024-02-17T23:17:27.148621+0000 mgr.y (mgr.14140) 113 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:17:29.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:28 smithi005 bash[38535]: cluster 2024-02-17T23:17:27.671232+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:29.127 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:28 smithi080 bash[35203]: audit 2024-02-17T23:17:27.147850+0000 mgr.y (mgr.14140) 112 : audit [DBG] from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:17:29.127 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:28 smithi080 bash[35203]: cephadm 2024-02-17T23:17:27.148621+0000 mgr.y (mgr.14140) 113 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:17:29.127 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:28 smithi080 bash[35203]: cluster 2024-02-17T23:17:27.671232+0000 mgr.y (mgr.14140) 114 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:29 smithi005 bash[35193]: audit 2024-02-17T23:17:28.753071+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:30.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:29 smithi005 bash[38535]: audit 2024-02-17T23:17:28.753071+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:30.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:29 smithi005 bash[35193]: audit 2024-02-17T23:17:28.937283+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:30.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:29 smithi005 bash[35193]: audit 2024-02-17T23:17:28.940506+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:29 smithi005 bash[38535]: audit 2024-02-17T23:17:28.937283+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:29 smithi005 bash[38535]: audit 2024-02-17T23:17:28.940506+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:29 smithi080 bash[35203]: audit 2024-02-17T23:17:28.753071+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:30.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:29 smithi080 bash[35203]: audit 2024-02-17T23:17:28.937283+0000 mon.a (mon.0) 361 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:30.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:29 smithi080 bash[35203]: audit 2024-02-17T23:17:28.940506+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}}, \"last_daemon_update\": \"2024-02-17T23:17:23.670659\", \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:31.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[35193]: cluster 2024-02-17T23:17:29.671516+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:31.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[35193]: audit 2024-02-17T23:17:30.025992+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.80:0/624064401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80950c10-2920-43c8-ad6c-f4b013db0c99"}]: dispatch 2024-02-17T23:17:31.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[35193]: audit 2024-02-17T23:17:30.026437+0000 mon.a (mon.0) 363 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80950c10-2920-43c8-ad6c-f4b013db0c99"}]: dispatch 2024-02-17T23:17:31.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[35193]: audit 2024-02-17T23:17:30.031046+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80950c10-2920-43c8-ad6c-f4b013db0c99"}]': finished 2024-02-17T23:17:31.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[35193]: cluster 2024-02-17T23:17:30.031107+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-17T23:17:31.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[35193]: audit 2024-02-17T23:17:30.031252+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:31.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[38535]: cluster 2024-02-17T23:17:29.671516+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:31.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[38535]: audit 2024-02-17T23:17:30.025992+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.80:0/624064401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80950c10-2920-43c8-ad6c-f4b013db0c99"}]: dispatch 2024-02-17T23:17:31.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[38535]: audit 2024-02-17T23:17:30.026437+0000 mon.a (mon.0) 363 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80950c10-2920-43c8-ad6c-f4b013db0c99"}]: dispatch 2024-02-17T23:17:31.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[38535]: audit 2024-02-17T23:17:30.031046+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80950c10-2920-43c8-ad6c-f4b013db0c99"}]': finished 2024-02-17T23:17:31.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[38535]: cluster 2024-02-17T23:17:30.031107+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-17T23:17:31.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:30 smithi005 bash[38535]: audit 2024-02-17T23:17:30.031252+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:30 smithi080 bash[35203]: cluster 2024-02-17T23:17:29.671516+0000 mgr.y (mgr.14140) 115 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.2 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:30 smithi080 bash[35203]: audit 2024-02-17T23:17:30.025992+0000 mon.b (mon.2) 9 : audit [INF] from='client.? 172.21.15.80:0/624064401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80950c10-2920-43c8-ad6c-f4b013db0c99"}]: dispatch 2024-02-17T23:17:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:30 smithi080 bash[35203]: audit 2024-02-17T23:17:30.026437+0000 mon.a (mon.0) 363 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80950c10-2920-43c8-ad6c-f4b013db0c99"}]: dispatch 2024-02-17T23:17:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:30 smithi080 bash[35203]: audit 2024-02-17T23:17:30.031046+0000 mon.a (mon.0) 364 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80950c10-2920-43c8-ad6c-f4b013db0c99"}]': finished 2024-02-17T23:17:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:30 smithi080 bash[35203]: cluster 2024-02-17T23:17:30.031107+0000 mon.a (mon.0) 365 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2024-02-17T23:17:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:30 smithi080 bash[35203]: audit 2024-02-17T23:17:30.031252+0000 mon.a (mon.0) 366 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:31 smithi005 bash[35193]: audit 2024-02-17T23:17:30.764688+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.80:0/1591893658' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:17:32.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:31 smithi005 bash[38535]: audit 2024-02-17T23:17:30.764688+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.80:0/1591893658' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:17:32.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:31 smithi080 bash[35203]: audit 2024-02-17T23:17:30.764688+0000 mon.b (mon.2) 10 : audit [DBG] from='client.? 172.21.15.80:0/1591893658' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:17:32.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:32 smithi080 bash[35203]: cluster 2024-02-17T23:17:31.671823+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:32 smithi005 bash[35193]: cluster 2024-02-17T23:17:31.671823+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:32 smithi005 bash[38535]: cluster 2024-02-17T23:17:31.671823+0000 mgr.y (mgr.14140) 116 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.3 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:33.963 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:33 smithi080 bash[35203]: audit 2024-02-17T23:17:33.273395+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:33 smithi005 bash[35193]: audit 2024-02-17T23:17:33.273395+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:33 smithi005 bash[38535]: audit 2024-02-17T23:17:33.273395+0000 mon.a (mon.0) 367 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:34.878 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:34 smithi080 bash[35203]: cluster 2024-02-17T23:17:33.672120+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:35.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:34 smithi005 bash[35193]: cluster 2024-02-17T23:17:33.672120+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:35.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:34 smithi005 bash[38535]: cluster 2024-02-17T23:17:33.672120+0000 mgr.y (mgr.14140) 117 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:36 smithi080 bash[35203]: cluster 2024-02-17T23:17:35.672417+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:36 smithi080 bash[35203]: audit 2024-02-17T23:17:36.203690+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:17:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:36 smithi080 bash[35203]: audit 2024-02-17T23:17:36.204558+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:36.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:36 smithi080 bash[35203]: audit 2024-02-17T23:17:36.205515+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-17T23:17:37.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:36 smithi005 bash[35193]: cluster 2024-02-17T23:17:35.672417+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:37.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:36 smithi005 bash[35193]: audit 2024-02-17T23:17:36.203690+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:17:37.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:36 smithi005 bash[35193]: audit 2024-02-17T23:17:36.204558+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:37.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:36 smithi005 bash[35193]: audit 2024-02-17T23:17:36.205515+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-17T23:17:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:36 smithi005 bash[38535]: cluster 2024-02-17T23:17:35.672417+0000 mgr.y (mgr.14140) 118 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:36 smithi005 bash[38535]: audit 2024-02-17T23:17:36.203690+0000 mon.a (mon.0) 368 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:17:37.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:36 smithi005 bash[38535]: audit 2024-02-17T23:17:36.204558+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:37.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:36 smithi005 bash[38535]: audit 2024-02-17T23:17:36.205515+0000 mon.a (mon.0) 370 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-17T23:17:37.782 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:37 smithi080 bash[35203]: cephadm 2024-02-17T23:17:36.205202+0000 mgr.y (mgr.14140) 119 : cephadm [INF] Deploying daemon osd.5 on smithi080 2024-02-17T23:17:37.821 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 5 on host 'smithi080' 2024-02-17T23:17:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:37 smithi005 bash[35193]: cephadm 2024-02-17T23:17:36.205202+0000 mgr.y (mgr.14140) 119 : cephadm [INF] Deploying daemon osd.5 on smithi080 2024-02-17T23:17:38.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:37 smithi005 bash[38535]: cephadm 2024-02-17T23:17:36.205202+0000 mgr.y (mgr.14140) 119 : cephadm [INF] Deploying daemon osd.5 on smithi080 2024-02-17T23:17:38.779 DEBUG:teuthology.orchestra.run.smithi080:osd.5> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.5.service 2024-02-17T23:17:38.781 INFO:tasks.cephadm:Deploying osd.6 on smithi080 with /dev/vg_nvme/lv_2... 2024-02-17T23:17:38.781 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-02-17T23:17:38.811 INFO:journalctl@ceph.osd.5.smithi080.stdout:-- Logs begin at Sat 2024-02-17 23:05:17 UTC. -- 2024-02-17T23:17:39.027 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:38 smithi080 bash[35203]: cluster 2024-02-17T23:17:37.672706+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:39.027 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:38 smithi080 bash[35203]: audit 2024-02-17T23:17:37.813867+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:39.027 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:38 smithi080 bash[35203]: audit 2024-02-17T23:17:37.814314+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:39.027 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:38 smithi080 bash[35203]: audit 2024-02-17T23:17:37.817055+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:39.027 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:38 smithi080 bash[35203]: audit 2024-02-17T23:17:38.692044+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-17T23:17:39.028 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:38 smithi080 bash[35203]: audit 2024-02-17T23:17:38.694774+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-17T23:17:39.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[35193]: cluster 2024-02-17T23:17:37.672706+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:39.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[38535]: cluster 2024-02-17T23:17:37.672706+0000 mgr.y (mgr.14140) 120 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:39.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[35193]: audit 2024-02-17T23:17:37.813867+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:39.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[35193]: audit 2024-02-17T23:17:37.814314+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:39.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[38535]: audit 2024-02-17T23:17:37.813867+0000 mon.a (mon.0) 371 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:39.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[38535]: audit 2024-02-17T23:17:37.814314+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:39.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[35193]: audit 2024-02-17T23:17:37.817055+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:39.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[35193]: audit 2024-02-17T23:17:38.692044+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-17T23:17:39.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[35193]: audit 2024-02-17T23:17:38.694774+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-17T23:17:39.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[38535]: audit 2024-02-17T23:17:37.817055+0000 mon.a (mon.0) 373 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670433\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670528\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:23.670568\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_device_update\": \"2024-02-17T23:17:28.936718\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:39.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[38535]: audit 2024-02-17T23:17:38.692044+0000 mon.a (mon.0) 374 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-17T23:17:39.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:38 smithi005 bash[38535]: audit 2024-02-17T23:17:38.694774+0000 mon.a (mon.0) 375 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-17T23:17:40.977 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:40 smithi080 bash[38927]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-17T23:17:40.977 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:40 smithi080 bash[38927]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-02-17T23:17:40.977 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:40 smithi080 bash[38927]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2024-02-17T23:17:40.977 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:40 smithi080 bash[38927]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-02-17T23:17:40.978 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:40 smithi080 bash[38927]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-17T23:17:40.978 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:40 smithi080 bash[38927]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-17T23:17:40.978 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:40 smithi080 bash[38927]: --> ceph-volume lvm activate successful for osd ID: 5 2024-02-17T23:17:40.978 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:40 smithi080 bash[35203]: cluster 2024-02-17T23:17:39.672990+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:41.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:40 smithi005 bash[35193]: cluster 2024-02-17T23:17:39.672990+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:41.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:40 smithi005 bash[38535]: cluster 2024-02-17T23:17:39.672990+0000 mgr.y (mgr.14140) 121 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-02-17T23:17:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-02-17T23:17:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-02-17T23:17:41.685 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-17T23:17:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-17T23:17:41.685 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110299 s, 951 MB/s 2024-02-17T23:17:41.685 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-17T23:17:42.768 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_2 2024-02-17T23:17:42.992 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:42 smithi080 bash[35203]: cluster 2024-02-17T23:17:41.673244+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:43.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:42 smithi005 bash[35193]: cluster 2024-02-17T23:17:41.673244+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:43.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:42 smithi005 bash[38535]: cluster 2024-02-17T23:17:41.673244+0000 mgr.y (mgr.14140) 122 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:43.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:43 smithi080 bash[35203]: audit 2024-02-17T23:17:42.796565+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:43.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:43 smithi080 bash[35203]: audit 2024-02-17T23:17:42.799426+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:43.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:43 smithi080 bash[35203]: audit 2024-02-17T23:17:42.800127+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:44.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:43 smithi005 bash[35193]: audit 2024-02-17T23:17:42.796565+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:44.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:43 smithi005 bash[38535]: audit 2024-02-17T23:17:42.796565+0000 mon.a (mon.0) 376 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:44.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:43 smithi005 bash[38535]: audit 2024-02-17T23:17:42.799426+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:44.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:43 smithi005 bash[38535]: audit 2024-02-17T23:17:42.800127+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:44.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:43 smithi005 bash[35193]: audit 2024-02-17T23:17:42.799426+0000 mon.a (mon.0) 377 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\", \"Insufficient space (<5GB) on vgs\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:44.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:43 smithi005 bash[35193]: audit 2024-02-17T23:17:42.800127+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:44.389 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:44 smithi080 bash[39322]: debug 2024-02-17T23:17:43.879+0000 7fe37b175ec0 -1 Falling back to public interface 2024-02-17T23:17:44.735 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:44 smithi080 bash[39322]: debug 2024-02-17T23:17:44.448+0000 7fe37b175ec0 -1 osd.5 0 log_to_monitors {default=true} 2024-02-17T23:17:45.094 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:44 smithi080 bash[35203]: cluster 2024-02-17T23:17:43.673534+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:45.094 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:44 smithi080 bash[35203]: audit 2024-02-17T23:17:44.452082+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/292412199,v1:172.21.15.80:6809/292412199]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:17:45.094 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:44 smithi080 bash[35203]: audit 2024-02-17T23:17:44.452402+0000 mon.a (mon.0) 379 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:17:45.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:44 smithi005 bash[35193]: cluster 2024-02-17T23:17:43.673534+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:45.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:44 smithi005 bash[35193]: audit 2024-02-17T23:17:44.452082+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/292412199,v1:172.21.15.80:6809/292412199]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:17:45.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:44 smithi005 bash[35193]: audit 2024-02-17T23:17:44.452402+0000 mon.a (mon.0) 379 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:17:45.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:44 smithi005 bash[38535]: cluster 2024-02-17T23:17:43.673534+0000 mgr.y (mgr.14140) 123 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:45.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:44 smithi005 bash[38535]: audit 2024-02-17T23:17:44.452082+0000 mon.b (mon.2) 11 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/292412199,v1:172.21.15.80:6809/292412199]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:17:45.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:44 smithi005 bash[38535]: audit 2024-02-17T23:17:44.452402+0000 mon.a (mon.0) 379 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:17:45.889 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:45 smithi080 bash[39322]: debug 2024-02-17T23:17:45.736+0000 7fe35ff22700 -1 osd.5 0 waiting for initial osdmap 2024-02-17T23:17:45.890 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:45 smithi080 bash[39322]: debug 2024-02-17T23:17:45.741+0000 7fe36b13e700 -1 osd.5 35 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-17T23:17:45.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:45 smithi080 bash[35203]: audit 2024-02-17T23:17:44.731556+0000 mon.a (mon.0) 380 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-17T23:17:45.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:45 smithi080 bash[35203]: cluster 2024-02-17T23:17:44.731616+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-17T23:17:45.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:45 smithi080 bash[35203]: audit 2024-02-17T23:17:44.732037+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/292412199,v1:172.21.15.80:6809/292412199]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:45.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:45 smithi080 bash[35203]: audit 2024-02-17T23:17:44.732239+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:45.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:45 smithi080 bash[35203]: audit 2024-02-17T23:17:44.732672+0000 mon.a (mon.0) 383 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:45 smithi005 bash[35193]: audit 2024-02-17T23:17:44.731556+0000 mon.a (mon.0) 380 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-17T23:17:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:45 smithi005 bash[35193]: cluster 2024-02-17T23:17:44.731616+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-17T23:17:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:45 smithi005 bash[35193]: audit 2024-02-17T23:17:44.732037+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/292412199,v1:172.21.15.80:6809/292412199]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:45 smithi005 bash[35193]: audit 2024-02-17T23:17:44.732239+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:45 smithi005 bash[35193]: audit 2024-02-17T23:17:44.732672+0000 mon.a (mon.0) 383 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:45 smithi005 bash[38535]: audit 2024-02-17T23:17:44.731556+0000 mon.a (mon.0) 380 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-17T23:17:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:45 smithi005 bash[38535]: cluster 2024-02-17T23:17:44.731616+0000 mon.a (mon.0) 381 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2024-02-17T23:17:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:45 smithi005 bash[38535]: audit 2024-02-17T23:17:44.732037+0000 mon.b (mon.2) 12 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/292412199,v1:172.21.15.80:6809/292412199]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:45 smithi005 bash[38535]: audit 2024-02-17T23:17:44.732239+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:45 smithi005 bash[38535]: audit 2024-02-17T23:17:44.732672+0000 mon.a (mon.0) 383 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:17:46.879 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: cluster 2024-02-17T23:17:45.490635+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:17:46.879 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: cluster 2024-02-17T23:17:45.490692+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:17:46.879 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: cluster 2024-02-17T23:17:45.673830+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:46.879 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: audit 2024-02-17T23:17:45.733205+0000 mon.a (mon.0) 384 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:17:46.880 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: cluster 2024-02-17T23:17:45.733283+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-17T23:17:46.880 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: audit 2024-02-17T23:17:45.733576+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:46.880 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: audit 2024-02-17T23:17:46.558333+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:17:46.880 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: audit 2024-02-17T23:17:46.559208+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:46.880 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: audit 2024-02-17T23:17:46.560424+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:46.880 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: cluster 2024-02-17T23:17:46.734526+0000 mon.a (mon.0) 390 : cluster [INF] osd.5 [v2:172.21.15.80:6808/292412199,v1:172.21.15.80:6809/292412199] boot 2024-02-17T23:17:46.880 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: cluster 2024-02-17T23:17:46.734569+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-17T23:17:46.880 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:46 smithi080 bash[35203]: audit 2024-02-17T23:17:46.734737+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: cluster 2024-02-17T23:17:45.490635+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:17:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: cluster 2024-02-17T23:17:45.490692+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:17:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: cluster 2024-02-17T23:17:45.673830+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: audit 2024-02-17T23:17:45.733205+0000 mon.a (mon.0) 384 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:17:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: cluster 2024-02-17T23:17:45.733283+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-17T23:17:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: audit 2024-02-17T23:17:45.733576+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: audit 2024-02-17T23:17:46.558333+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:17:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: audit 2024-02-17T23:17:46.559208+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: audit 2024-02-17T23:17:46.560424+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: cluster 2024-02-17T23:17:46.734526+0000 mon.a (mon.0) 390 : cluster [INF] osd.5 [v2:172.21.15.80:6808/292412199,v1:172.21.15.80:6809/292412199] boot 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: cluster 2024-02-17T23:17:46.734569+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[35193]: audit 2024-02-17T23:17:46.734737+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: cluster 2024-02-17T23:17:45.490635+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: cluster 2024-02-17T23:17:45.490692+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: cluster 2024-02-17T23:17:45.673830+0000 mgr.y (mgr.14140) 124 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 1.4 MiB used, 442 GiB / 447 GiB avail 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: audit 2024-02-17T23:17:45.733205+0000 mon.a (mon.0) 384 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: cluster 2024-02-17T23:17:45.733283+0000 mon.a (mon.0) 385 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: audit 2024-02-17T23:17:45.733576+0000 mon.a (mon.0) 386 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: audit 2024-02-17T23:17:46.558333+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: audit 2024-02-17T23:17:46.559208+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: audit 2024-02-17T23:17:46.560424+0000 mon.a (mon.0) 389 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:47.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: cluster 2024-02-17T23:17:46.734526+0000 mon.a (mon.0) 390 : cluster [INF] osd.5 [v2:172.21.15.80:6808/292412199,v1:172.21.15.80:6809/292412199] boot 2024-02-17T23:17:47.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: cluster 2024-02-17T23:17:46.734569+0000 mon.a (mon.0) 391 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2024-02-17T23:17:47.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:46 smithi005 bash[38535]: audit 2024-02-17T23:17:46.734737+0000 mon.a (mon.0) 392 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:17:47.749 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:47 smithi080 bash[35203]: audit 2024-02-17T23:17:46.557244+0000 mgr.y (mgr.14140) 125 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:17:47.749 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:47 smithi080 bash[35203]: cephadm 2024-02-17T23:17:46.558002+0000 mgr.y (mgr.14140) 126 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:17:47.749 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:47 smithi080 bash[35203]: audit 2024-02-17T23:17:47.462986+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:47.749 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:47 smithi080 bash[35203]: audit 2024-02-17T23:17:47.647005+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:47.749 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:47 smithi080 bash[35203]: audit 2024-02-17T23:17:47.651220+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:47 smithi005 bash[38535]: audit 2024-02-17T23:17:46.557244+0000 mgr.y (mgr.14140) 125 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:17:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:47 smithi005 bash[38535]: cephadm 2024-02-17T23:17:46.558002+0000 mgr.y (mgr.14140) 126 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:17:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:47 smithi005 bash[38535]: audit 2024-02-17T23:17:47.462986+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:47 smithi005 bash[35193]: audit 2024-02-17T23:17:46.557244+0000 mgr.y (mgr.14140) 125 : audit [DBG] from='client.34247 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:17:48.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:47 smithi005 bash[35193]: cephadm 2024-02-17T23:17:46.558002+0000 mgr.y (mgr.14140) 126 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:17:48.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:47 smithi005 bash[35193]: audit 2024-02-17T23:17:47.462986+0000 mon.a (mon.0) 393 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:17:48.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:47 smithi005 bash[35193]: audit 2024-02-17T23:17:47.647005+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:48.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:47 smithi005 bash[35193]: audit 2024-02-17T23:17:47.651220+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:48.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:47 smithi005 bash[38535]: audit 2024-02-17T23:17:47.647005+0000 mon.a (mon.0) 394 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:17:48.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:47 smithi005 bash[38535]: audit 2024-02-17T23:17:47.651220+0000 mon.a (mon.0) 395 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795793\", \"created\": \"2024-02-17T23:17:37.782405\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:36.203384\"}}, \"last_daemon_update\": \"2024-02-17T23:17:42.795875\", \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:17:48.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:48 smithi080 bash[35203]: cluster 2024-02-17T23:17:47.674098+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:48.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:48 smithi080 bash[35203]: cluster 2024-02-17T23:17:47.744663+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-17T23:17:49.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:48 smithi005 bash[35193]: cluster 2024-02-17T23:17:47.674098+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:49.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:48 smithi005 bash[35193]: cluster 2024-02-17T23:17:47.744663+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-17T23:17:49.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:48 smithi005 bash[38535]: cluster 2024-02-17T23:17:47.674098+0000 mgr.y (mgr.14140) 127 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:49.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:48 smithi005 bash[38535]: cluster 2024-02-17T23:17:47.744663+0000 mon.a (mon.0) 396 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-02-17T23:17:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:49 smithi005 bash[35193]: audit 2024-02-17T23:17:49.191867+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.80:0/3880490420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ac05a2a-eebb-480e-aed6-dfa0c7cc9399"}]: dispatch 2024-02-17T23:17:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:49 smithi005 bash[35193]: audit 2024-02-17T23:17:49.192348+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ac05a2a-eebb-480e-aed6-dfa0c7cc9399"}]: dispatch 2024-02-17T23:17:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:49 smithi005 bash[35193]: audit 2024-02-17T23:17:49.197035+0000 mon.a (mon.0) 398 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ac05a2a-eebb-480e-aed6-dfa0c7cc9399"}]': finished 2024-02-17T23:17:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:49 smithi005 bash[35193]: cluster 2024-02-17T23:17:49.197101+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-17T23:17:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:49 smithi005 bash[35193]: audit 2024-02-17T23:17:49.197296+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:17:50.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:49 smithi005 bash[38535]: audit 2024-02-17T23:17:49.191867+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.80:0/3880490420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ac05a2a-eebb-480e-aed6-dfa0c7cc9399"}]: dispatch 2024-02-17T23:17:50.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:49 smithi005 bash[38535]: audit 2024-02-17T23:17:49.192348+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ac05a2a-eebb-480e-aed6-dfa0c7cc9399"}]: dispatch 2024-02-17T23:17:50.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:49 smithi005 bash[38535]: audit 2024-02-17T23:17:49.197035+0000 mon.a (mon.0) 398 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ac05a2a-eebb-480e-aed6-dfa0c7cc9399"}]': finished 2024-02-17T23:17:50.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:49 smithi005 bash[38535]: cluster 2024-02-17T23:17:49.197101+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-17T23:17:50.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:49 smithi005 bash[38535]: audit 2024-02-17T23:17:49.197296+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:17:50.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:49 smithi080 bash[35203]: audit 2024-02-17T23:17:49.191867+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.80:0/3880490420' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ac05a2a-eebb-480e-aed6-dfa0c7cc9399"}]: dispatch 2024-02-17T23:17:50.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:49 smithi080 bash[35203]: audit 2024-02-17T23:17:49.192348+0000 mon.a (mon.0) 397 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0ac05a2a-eebb-480e-aed6-dfa0c7cc9399"}]: dispatch 2024-02-17T23:17:50.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:49 smithi080 bash[35203]: audit 2024-02-17T23:17:49.197035+0000 mon.a (mon.0) 398 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ac05a2a-eebb-480e-aed6-dfa0c7cc9399"}]': finished 2024-02-17T23:17:50.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:49 smithi080 bash[35203]: cluster 2024-02-17T23:17:49.197101+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2024-02-17T23:17:50.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:49 smithi080 bash[35203]: audit 2024-02-17T23:17:49.197296+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:17:51.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:50 smithi005 bash[35193]: cluster 2024-02-17T23:17:49.674389+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:51.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:50 smithi005 bash[35193]: audit 2024-02-17T23:17:49.912716+0000 mon.b (mon.2) 14 : audit [DBG] from='client.? 172.21.15.80:0/1412365085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:17:51.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:50 smithi005 bash[38535]: cluster 2024-02-17T23:17:49.674389+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:51.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:50 smithi005 bash[38535]: audit 2024-02-17T23:17:49.912716+0000 mon.b (mon.2) 14 : audit [DBG] from='client.? 172.21.15.80:0/1412365085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:17:51.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:50 smithi080 bash[35203]: cluster 2024-02-17T23:17:49.674389+0000 mgr.y (mgr.14140) 128 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.8 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:51.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:50 smithi080 bash[35203]: audit 2024-02-17T23:17:49.912716+0000 mon.b (mon.2) 14 : audit [DBG] from='client.? 172.21.15.80:0/1412365085' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:17:53.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:52 smithi080 bash[35203]: cluster 2024-02-17T23:17:51.674664+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:53.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:52 smithi080 bash[35203]: audit 2024-02-17T23:17:52.454721+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:53.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:52 smithi005 bash[35193]: cluster 2024-02-17T23:17:51.674664+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:53.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:52 smithi005 bash[35193]: audit 2024-02-17T23:17:52.454721+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:53.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:52 smithi005 bash[38535]: cluster 2024-02-17T23:17:51.674664+0000 mgr.y (mgr.14140) 129 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.9 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:53.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:52 smithi005 bash[38535]: audit 2024-02-17T23:17:52.454721+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:17:54.876 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:54 smithi080 bash[35203]: cluster 2024-02-17T23:17:53.674940+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:54 smithi005 bash[35193]: cluster 2024-02-17T23:17:53.674940+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:55.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:54 smithi005 bash[38535]: cluster 2024-02-17T23:17:53.674940+0000 mgr.y (mgr.14140) 130 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:55.885 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:55 smithi080 bash[35203]: audit 2024-02-17T23:17:55.192576+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:17:55.885 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:55 smithi080 bash[35203]: audit 2024-02-17T23:17:55.193383+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:55.885 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:55 smithi080 bash[35203]: audit 2024-02-17T23:17:55.194255+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-17T23:17:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:55 smithi005 bash[35193]: audit 2024-02-17T23:17:55.192576+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:17:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:55 smithi005 bash[35193]: audit 2024-02-17T23:17:55.193383+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:55 smithi005 bash[35193]: audit 2024-02-17T23:17:55.194255+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-17T23:17:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:55 smithi005 bash[38535]: audit 2024-02-17T23:17:55.192576+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:17:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:55 smithi005 bash[38535]: audit 2024-02-17T23:17:55.193383+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:17:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:55 smithi005 bash[38535]: audit 2024-02-17T23:17:55.194255+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2024-02-17T23:17:56.935 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:56 smithi080 bash[35203]: cephadm 2024-02-17T23:17:55.193950+0000 mgr.y (mgr.14140) 131 : cephadm [INF] Deploying daemon osd.5 on smithi080 2024-02-17T23:17:56.935 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:56 smithi080 bash[35203]: cluster 2024-02-17T23:17:55.675229+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:56.935 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:56 smithi080 systemd[1]: Stopping Ceph osd.5 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:17:56.936 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:56 smithi080 bash[39322]: debug 2024-02-17T23:17:56.886+0000 7fe3729bd700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:17:56.936 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:56 smithi080 bash[39322]: debug 2024-02-17T23:17:56.886+0000 7fe3729bd700 -1 osd.5 38 *** Got signal Terminated *** 2024-02-17T23:17:56.936 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:56 smithi080 bash[39322]: debug 2024-02-17T23:17:56.886+0000 7fe3729bd700 -1 osd.5 38 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:17:57.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:56 smithi005 bash[35193]: cephadm 2024-02-17T23:17:55.193950+0000 mgr.y (mgr.14140) 131 : cephadm [INF] Deploying daemon osd.5 on smithi080 2024-02-17T23:17:57.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:56 smithi005 bash[35193]: cluster 2024-02-17T23:17:55.675229+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:57.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:56 smithi005 bash[38535]: cephadm 2024-02-17T23:17:55.193950+0000 mgr.y (mgr.14140) 131 : cephadm [INF] Deploying daemon osd.5 on smithi080 2024-02-17T23:17:57.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:56 smithi005 bash[38535]: cluster 2024-02-17T23:17:55.675229+0000 mgr.y (mgr.14140) 132 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:57.582 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:57 smithi080 podman[40422]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.5 2024-02-17T23:17:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:56.930975+0000 mon.a (mon.0) 405 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:56.931025+0000 mon.a (mon.0) 406 : cluster [INF] osd.5 failed (root=default,host=smithi080) (connection refused reported by osd.1) 2024-02-17T23:17:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:56.931355+0000 mon.a (mon.0) 407 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:56.931601+0000 mon.a (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:56.931776+0000 mon.a (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:56.931946+0000 mon.a (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:56.932124+0000 mon.a (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:56.932302+0000 mon.a (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:56.932471+0000 mon.a (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.131456+0000 mon.a (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.131674+0000 mon.a (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.131773+0000 mon.a (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.132041+0000 mon.a (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.132170+0000 mon.a (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.132313+0000 mon.a (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.132497+0000 mon.a (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.132669+0000 mon.a (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.132834+0000 mon.a (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.132994+0000 mon.a (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.532477+0000 mon.a (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.532643+0000 mon.a (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.532708+0000 mon.a (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.532898+0000 mon.a (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.533006+0000 mon.a (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.533147+0000 mon.a (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.533277+0000 mon.a (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.533373+0000 mon.a (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.533534+0000 mon.a (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.533626+0000 mon.a (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:56.930975+0000 mon.a (mon.0) 405 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:56.931025+0000 mon.a (mon.0) 406 : cluster [INF] osd.5 failed (root=default,host=smithi080) (connection refused reported by osd.1) 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:56.931355+0000 mon.a (mon.0) 407 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:56.931601+0000 mon.a (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:56.931776+0000 mon.a (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:56.931946+0000 mon.a (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:56.932124+0000 mon.a (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:56.932302+0000 mon.a (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:56.932471+0000 mon.a (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.131456+0000 mon.a (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.131674+0000 mon.a (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.131773+0000 mon.a (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.132041+0000 mon.a (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.132170+0000 mon.a (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.132313+0000 mon.a (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.132497+0000 mon.a (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.132669+0000 mon.a (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.132834+0000 mon.a (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.132994+0000 mon.a (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.532477+0000 mon.a (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.532643+0000 mon.a (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.532708+0000 mon.a (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.532898+0000 mon.a (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.533006+0000 mon.a (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.533147+0000 mon.a (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.533277+0000 mon.a (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.533373+0000 mon.a (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.533534+0000 mon.a (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:57 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.533626+0000 mon.a (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:56.930975+0000 mon.a (mon.0) 405 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:56.931025+0000 mon.a (mon.0) 406 : cluster [INF] osd.5 failed (root=default,host=smithi080) (connection refused reported by osd.1) 2024-02-17T23:17:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:56.931355+0000 mon.a (mon.0) 407 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:56.931601+0000 mon.a (mon.0) 408 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:56.931776+0000 mon.a (mon.0) 409 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:56.931946+0000 mon.a (mon.0) 410 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:56.932124+0000 mon.a (mon.0) 411 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:56.932302+0000 mon.a (mon.0) 412 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:56.932471+0000 mon.a (mon.0) 413 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.131456+0000 mon.a (mon.0) 414 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.131674+0000 mon.a (mon.0) 415 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.131773+0000 mon.a (mon.0) 416 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.132041+0000 mon.a (mon.0) 417 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.132170+0000 mon.a (mon.0) 418 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.132313+0000 mon.a (mon.0) 419 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.132497+0000 mon.a (mon.0) 420 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.132669+0000 mon.a (mon.0) 421 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.132834+0000 mon.a (mon.0) 422 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.132994+0000 mon.a (mon.0) 423 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.532477+0000 mon.a (mon.0) 424 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.532643+0000 mon.a (mon.0) 425 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:17:58.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.532708+0000 mon.a (mon.0) 426 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.532898+0000 mon.a (mon.0) 427 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.533006+0000 mon.a (mon.0) 428 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:17:58.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.533147+0000 mon.a (mon.0) 429 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.533277+0000 mon.a (mon.0) 430 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.533373+0000 mon.a (mon.0) 431 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:17:58.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.533534+0000 mon.a (mon.0) 432 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:17:58.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:57 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.533626+0000 mon.a (mon.0) 433 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:17:58.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:58 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.672678+0000 mon.a (mon.0) 434 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:17:58.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:58 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.678143+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:58.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:58 smithi080 bash[35203]: cluster 2024-02-17T23:17:57.681891+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e39: 7 total, 5 up, 6 in 2024-02-17T23:17:58.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:58 smithi080 bash[35203]: audit 2024-02-17T23:17:57.682126+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:17:59.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:58 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.672678+0000 mon.a (mon.0) 434 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:17:59.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:58 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.678143+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:59.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:58 smithi005 bash[35193]: cluster 2024-02-17T23:17:57.681891+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e39: 7 total, 5 up, 6 in 2024-02-17T23:17:59.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:58 smithi005 bash[35193]: audit 2024-02-17T23:17:57.682126+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:17:59.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:58 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.672678+0000 mon.a (mon.0) 434 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:17:59.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:58 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.678143+0000 mgr.y (mgr.14140) 133 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:17:59.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:58 smithi005 bash[38535]: cluster 2024-02-17T23:17:57.681891+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e39: 7 total, 5 up, 6 in 2024-02-17T23:17:59.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:58 smithi005 bash[38535]: audit 2024-02-17T23:17:57.682126+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:17:59.295 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:58 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.5.service: Succeeded. 2024-02-17T23:17:59.295 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:58 smithi080 systemd[1]: Stopped Ceph osd.5 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:17:59.295 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:59 smithi080 systemd[1]: Starting Ceph osd.5 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:17:59.295 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:59 smithi080 podman[40558]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.5" found: no such container 2024-02-17T23:17:59.295 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:17:59 smithi080 systemd[1]: Started Ceph osd.5 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:18:00.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[35193]: cluster 2024-02-17T23:17:58.683757+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e40: 7 total, 5 up, 6 in 2024-02-17T23:18:00.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[35193]: audit 2024-02-17T23:17:58.683933+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:00.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[38535]: cluster 2024-02-17T23:17:58.683757+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e40: 7 total, 5 up, 6 in 2024-02-17T23:18:00.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[38535]: audit 2024-02-17T23:17:58.683933+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:00.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[35193]: audit 2024-02-17T23:17:59.066038+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:00.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[35193]: audit 2024-02-17T23:17:59.066534+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:00.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[38535]: audit 2024-02-17T23:17:59.066038+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:00.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[38535]: audit 2024-02-17T23:17:59.066534+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:00.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[35193]: audit 2024-02-17T23:17:59.069344+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:00.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[35193]: audit 2024-02-17T23:17:59.070722+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-17T23:18:00.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[35193]: audit 2024-02-17T23:17:59.072030+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:00.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[35193]: audit 2024-02-17T23:17:59.072975+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-17T23:18:00.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[38535]: audit 2024-02-17T23:17:59.069344+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:00.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[38535]: audit 2024-02-17T23:17:59.070722+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-17T23:18:00.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[38535]: audit 2024-02-17T23:17:59.072030+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:00.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:17:59 smithi005 bash[38535]: audit 2024-02-17T23:17:59.072975+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-17T23:18:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:59 smithi080 bash[35203]: cluster 2024-02-17T23:17:58.683757+0000 mon.a (mon.0) 437 : cluster [DBG] osdmap e40: 7 total, 5 up, 6 in 2024-02-17T23:18:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:59 smithi080 bash[35203]: audit 2024-02-17T23:17:58.683933+0000 mon.a (mon.0) 438 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:59 smithi080 bash[35203]: audit 2024-02-17T23:17:59.066038+0000 mon.a (mon.0) 439 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:59 smithi080 bash[35203]: audit 2024-02-17T23:17:59.066534+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:59 smithi080 bash[35203]: audit 2024-02-17T23:17:59.069344+0000 mon.a (mon.0) 441 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:59 smithi080 bash[35203]: audit 2024-02-17T23:17:59.070722+0000 mon.a (mon.0) 442 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-17T23:18:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:59 smithi080 bash[35203]: audit 2024-02-17T23:17:59.072030+0000 mon.a (mon.0) 443 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:17:59 smithi080 bash[35203]: audit 2024-02-17T23:17:59.072975+0000 mon.a (mon.0) 444 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2024-02-17T23:18:00.607 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:00 smithi080 bash[40574]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-17T23:18:00.607 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:00 smithi080 bash[40574]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-02-17T23:18:00.607 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:00 smithi080 bash[40574]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2024-02-17T23:18:00.608 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:00 smithi080 bash[40574]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-02-17T23:18:00.608 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:00 smithi080 bash[40574]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-17T23:18:00.608 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:00 smithi080 bash[40574]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-17T23:18:00.608 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:00 smithi080 bash[40574]: --> ceph-volume lvm activate successful for osd ID: 5 2024-02-17T23:18:00.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:00 smithi080 bash[35203]: cephadm 2024-02-17T23:17:59.072673+0000 mgr.y (mgr.14140) 134 : cephadm [INF] Deploying daemon osd.6 on smithi080 2024-02-17T23:18:00.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:00 smithi080 bash[35203]: cluster 2024-02-17T23:17:59.678464+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 stale+active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:01.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:00 smithi005 bash[35193]: cephadm 2024-02-17T23:17:59.072673+0000 mgr.y (mgr.14140) 134 : cephadm [INF] Deploying daemon osd.6 on smithi080 2024-02-17T23:18:01.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:00 smithi005 bash[35193]: cluster 2024-02-17T23:17:59.678464+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 stale+active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:01.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:00 smithi005 bash[38535]: cephadm 2024-02-17T23:17:59.072673+0000 mgr.y (mgr.14140) 134 : cephadm [INF] Deploying daemon osd.6 on smithi080 2024-02-17T23:18:01.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:00 smithi005 bash[38535]: cluster 2024-02-17T23:17:59.678464+0000 mgr.y (mgr.14140) 135 : cluster [DBG] pgmap v136: 1 pgs: 1 stale+active+clean; 0 B data, 2.0 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:02.051 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:01 smithi080 bash[40758]: debug 2024-02-17T23:18:01.929+0000 7f7b378d5ec0 -1 Falling back to public interface 2024-02-17T23:18:02.101 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 5,6 on host 'smithi080' 2024-02-17T23:18:02.890 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:02 smithi080 bash[40758]: debug 2024-02-17T23:18:02.479+0000 7f7b378d5ec0 -1 osd.5 38 log_to_monitors {default=true} 2024-02-17T23:18:02.890 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:02 smithi080 bash[40758]: debug 2024-02-17T23:18:02.486+0000 7f7b2789e700 -1 osd.5 38 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-17T23:18:02.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:02 smithi080 bash[35203]: cluster 2024-02-17T23:18:01.678898+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 stale+active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:02.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:02 smithi080 bash[35203]: audit 2024-02-17T23:18:02.095439+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:02.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:02 smithi080 bash[35203]: audit 2024-02-17T23:18:02.098627+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:02.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:02 smithi080 bash[35203]: audit 2024-02-17T23:18:02.484083+0000 mon.b (mon.2) 15 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/3311768384,v1:172.21.15.80:6809/3311768384]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:18:02.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:02 smithi080 bash[35203]: audit 2024-02-17T23:18:02.484414+0000 mon.a (mon.0) 447 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:18:02.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:02 smithi080 bash[35203]: audit 2024-02-17T23:18:02.484861+0000 mon.b (mon.2) 16 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/3311768384,v1:172.21.15.80:6809/3311768384]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:02.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:02 smithi080 bash[35203]: audit 2024-02-17T23:18:02.485145+0000 mon.a (mon.0) 448 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:02.905 DEBUG:teuthology.orchestra.run.smithi080:osd.6> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.6.service 2024-02-17T23:18:02.908 INFO:tasks.cephadm:Deploying osd.7 on smithi080 with /dev/vg_nvme/lv_1... 2024-02-17T23:18:02.908 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-02-17T23:18:02.937 INFO:journalctl@ceph.osd.6.smithi080.stdout:-- Logs begin at Sat 2024-02-17 23:05:17 UTC. -- 2024-02-17T23:18:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[35193]: cluster 2024-02-17T23:18:01.678898+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 stale+active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:03.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[38535]: cluster 2024-02-17T23:18:01.678898+0000 mgr.y (mgr.14140) 136 : cluster [DBG] pgmap v137: 1 pgs: 1 stale+active+clean; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[35193]: audit 2024-02-17T23:18:02.095439+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:03.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[38535]: audit 2024-02-17T23:18:02.095439+0000 mon.a (mon.0) 445 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[35193]: audit 2024-02-17T23:18:02.098627+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[35193]: audit 2024-02-17T23:18:02.484083+0000 mon.b (mon.2) 15 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/3311768384,v1:172.21.15.80:6809/3311768384]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:18:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[35193]: audit 2024-02-17T23:18:02.484414+0000 mon.a (mon.0) 447 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:18:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[35193]: audit 2024-02-17T23:18:02.484861+0000 mon.b (mon.2) 16 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/3311768384,v1:172.21.15.80:6809/3311768384]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[35193]: audit 2024-02-17T23:18:02.485145+0000 mon.a (mon.0) 448 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[38535]: audit 2024-02-17T23:18:02.098627+0000 mon.a (mon.0) 446 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795619\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795719\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:42.795758\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_device_update\": \"2024-02-17T23:17:47.646396\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[38535]: audit 2024-02-17T23:18:02.484083+0000 mon.b (mon.2) 15 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/3311768384,v1:172.21.15.80:6809/3311768384]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:18:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[38535]: audit 2024-02-17T23:18:02.484414+0000 mon.a (mon.0) 447 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:18:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[38535]: audit 2024-02-17T23:18:02.484861+0000 mon.b (mon.2) 16 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/3311768384,v1:172.21.15.80:6809/3311768384]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:02 smithi005 bash[38535]: audit 2024-02-17T23:18:02.485145+0000 mon.a (mon.0) 448 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:04.013 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:03 smithi080 bash[35203]: cluster 2024-02-17T23:18:03.097169+0000 mon.a (mon.0) 449 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:18:04.013 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:03 smithi080 bash[35203]: cluster 2024-02-17T23:18:03.097215+0000 mon.a (mon.0) 450 : cluster [INF] Cluster is now healthy 2024-02-17T23:18:04.013 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:03 smithi080 bash[35203]: cluster 2024-02-17T23:18:03.102057+0000 mon.a (mon.0) 451 : cluster [INF] osd.5 [v2:172.21.15.80:6808/3311768384,v1:172.21.15.80:6809/3311768384] boot 2024-02-17T23:18:04.013 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:03 smithi080 bash[35203]: cluster 2024-02-17T23:18:03.102115+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2024-02-17T23:18:04.014 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:03 smithi080 bash[35203]: audit 2024-02-17T23:18:03.102259+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:18:04.014 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:03 smithi080 bash[35203]: audit 2024-02-17T23:18:03.102615+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[35193]: cluster 2024-02-17T23:18:03.097169+0000 mon.a (mon.0) 449 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:18:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[35193]: cluster 2024-02-17T23:18:03.097215+0000 mon.a (mon.0) 450 : cluster [INF] Cluster is now healthy 2024-02-17T23:18:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[35193]: cluster 2024-02-17T23:18:03.102057+0000 mon.a (mon.0) 451 : cluster [INF] osd.5 [v2:172.21.15.80:6808/3311768384,v1:172.21.15.80:6809/3311768384] boot 2024-02-17T23:18:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[35193]: cluster 2024-02-17T23:18:03.102115+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2024-02-17T23:18:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[35193]: audit 2024-02-17T23:18:03.102259+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:18:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[35193]: audit 2024-02-17T23:18:03.102615+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:04.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[38535]: cluster 2024-02-17T23:18:03.097169+0000 mon.a (mon.0) 449 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:18:04.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[38535]: cluster 2024-02-17T23:18:03.097215+0000 mon.a (mon.0) 450 : cluster [INF] Cluster is now healthy 2024-02-17T23:18:04.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[38535]: cluster 2024-02-17T23:18:03.102057+0000 mon.a (mon.0) 451 : cluster [INF] osd.5 [v2:172.21.15.80:6808/3311768384,v1:172.21.15.80:6809/3311768384] boot 2024-02-17T23:18:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[38535]: cluster 2024-02-17T23:18:03.102115+0000 mon.a (mon.0) 452 : cluster [DBG] osdmap e41: 7 total, 6 up, 6 in 2024-02-17T23:18:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[38535]: audit 2024-02-17T23:18:03.102259+0000 mon.a (mon.0) 453 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:18:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:03 smithi005 bash[38535]: audit 2024-02-17T23:18:03.102615+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:04.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[40914]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-17T23:18:04.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[40914]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2024-02-17T23:18:04.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[40914]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2024-02-17T23:18:04.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[40914]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2024-02-17T23:18:04.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[40914]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-17T23:18:04.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[40914]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-17T23:18:04.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[40914]: --> ceph-volume lvm activate successful for osd ID: 6 2024-02-17T23:18:05.049 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[35203]: cluster 2024-02-17T23:18:03.679354+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v139: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:18:05.049 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[35203]: cluster 2024-02-17T23:18:04.103591+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2024-02-17T23:18:05.049 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[35203]: audit 2024-02-17T23:18:04.103795+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:05.050 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:04 smithi080 bash[35203]: cluster 2024-02-17T23:18:04.662210+0000 mon.a (mon.0) 457 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-17T23:18:05.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:04 smithi005 bash[35193]: cluster 2024-02-17T23:18:03.679354+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v139: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:18:05.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:04 smithi005 bash[35193]: cluster 2024-02-17T23:18:04.103591+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2024-02-17T23:18:05.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:04 smithi005 bash[35193]: audit 2024-02-17T23:18:04.103795+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:05.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:04 smithi005 bash[35193]: cluster 2024-02-17T23:18:04.662210+0000 mon.a (mon.0) 457 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-17T23:18:05.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:04 smithi005 bash[38535]: cluster 2024-02-17T23:18:03.679354+0000 mgr.y (mgr.14140) 137 : cluster [DBG] pgmap v139: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.1 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:18:05.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:04 smithi005 bash[38535]: cluster 2024-02-17T23:18:04.103591+0000 mon.a (mon.0) 455 : cluster [DBG] osdmap e42: 7 total, 6 up, 6 in 2024-02-17T23:18:05.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:04 smithi005 bash[38535]: audit 2024-02-17T23:18:04.103795+0000 mon.a (mon.0) 456 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:05.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:04 smithi005 bash[38535]: cluster 2024-02-17T23:18:04.662210+0000 mon.a (mon.0) 457 : cluster [WRN] Health check failed: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-02-17T23:18:06.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:05 smithi005 bash[35193]: audit 2024-02-17T23:18:04.694711+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:06.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:05 smithi005 bash[38535]: audit 2024-02-17T23:18:04.694711+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:06.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:05 smithi005 bash[35193]: audit 2024-02-17T23:18:04.697585+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:06.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:05 smithi005 bash[35193]: audit 2024-02-17T23:18:04.698295+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:06.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:05 smithi005 bash[38535]: audit 2024-02-17T23:18:04.697585+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:06.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:05 smithi005 bash[38535]: audit 2024-02-17T23:18:04.698295+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:06.129 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:05 smithi080 bash[35203]: audit 2024-02-17T23:18:04.694711+0000 mon.a (mon.0) 458 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:06.129 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:05 smithi080 bash[35203]: audit 2024-02-17T23:18:04.697585+0000 mon.a (mon.0) 459 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"LVM detected\", \"Insufficient space (<5GB) on vgs\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:06.129 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:05 smithi080 bash[35203]: audit 2024-02-17T23:18:04.698295+0000 mon.a (mon.0) 460 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:06.958 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:06 smithi080 bash[35203]: cluster 2024-02-17T23:18:05.679700+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v141: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:18:07.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:06 smithi005 bash[35193]: cluster 2024-02-17T23:18:05.679700+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v141: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:18:07.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:06 smithi005 bash[38535]: cluster 2024-02-17T23:18:05.679700+0000 mgr.y (mgr.14140) 138 : cluster [DBG] pgmap v141: 1 pgs: 1 active+undersized+degraded; 0 B data, 2.2 MiB used, 530 GiB / 536 GiB avail; 1/3 objects degraded (33.333%) 2024-02-17T23:18:07.291 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:06 smithi080 bash[41341]: debug 2024-02-17T23:18:06.770+0000 7feacaa27ec0 1 -- 172.21.15.80:0/3619843690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55756a6ecc00 msgr2=0x55756a6e9680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-02-17T23:18:07.291 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:06 smithi080 bash[41341]: debug 2024-02-17T23:18:06.770+0000 7feacaa27ec0 1 --2- 172.21.15.80:0/3619843690 >> [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] conn(0x55756a6ecc00 0x55756a6e9680 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x55756a67fd10 tx=0x55756b358aa0).stop 2024-02-17T23:18:07.639 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:07 smithi080 bash[41341]: debug 2024-02-17T23:18:07.289+0000 7feacaa27ec0 -1 Falling back to public interface 2024-02-17T23:18:07.754 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-02-17T23:18:07.754 INFO:teuthology.orchestra.run.smithi080.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-02-17T23:18:07.754 INFO:teuthology.orchestra.run.smithi080.stderr: stderr: 10+0 records in 2024-02-17T23:18:07.754 INFO:teuthology.orchestra.run.smithi080.stderr:10+0 records out 2024-02-17T23:18:07.754 INFO:teuthology.orchestra.run.smithi080.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0159225 s, 659 MB/s 2024-02-17T23:18:07.754 INFO:teuthology.orchestra.run.smithi080.stderr:--> Zapping successful for: 2024-02-17T23:18:08.091 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:07 smithi080 bash[41341]: debug 2024-02-17T23:18:07.844+0000 7feacaa27ec0 -1 osd.6 0 log_to_monitors {default=true} 2024-02-17T23:18:08.091 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:07 smithi080 bash[35203]: cluster 2024-02-17T23:18:07.700239+0000 mon.a (mon.0) 461 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-17T23:18:08.092 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:07 smithi080 bash[35203]: cluster 2024-02-17T23:18:07.700300+0000 mon.a (mon.0) 462 : cluster [INF] Cluster is now healthy 2024-02-17T23:18:08.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:07 smithi005 bash[35193]: cluster 2024-02-17T23:18:07.700239+0000 mon.a (mon.0) 461 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-17T23:18:08.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:07 smithi005 bash[35193]: cluster 2024-02-17T23:18:07.700300+0000 mon.a (mon.0) 462 : cluster [INF] Cluster is now healthy 2024-02-17T23:18:08.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:07 smithi005 bash[38535]: cluster 2024-02-17T23:18:07.700239+0000 mon.a (mon.0) 461 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/3 objects degraded (33.333%), 1 pg degraded) 2024-02-17T23:18:08.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:07 smithi005 bash[38535]: cluster 2024-02-17T23:18:07.700300+0000 mon.a (mon.0) 462 : cluster [INF] Cluster is now healthy 2024-02-17T23:18:08.459 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch daemon add osd smithi080:vg_nvme/lv_1 2024-02-17T23:18:08.982 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:08 smithi080 bash[35203]: cluster 2024-02-17T23:18:07.680136+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean+wait; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:08.982 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:08 smithi080 bash[35203]: audit 2024-02-17T23:18:07.847840+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/2982577173,v1:172.21.15.80:6817/2982577173]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:18:08.982 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:08 smithi080 bash[35203]: audit 2024-02-17T23:18:07.848277+0000 mon.a (mon.0) 463 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:18:09.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:08 smithi005 bash[35193]: cluster 2024-02-17T23:18:07.680136+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean+wait; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:09.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:08 smithi005 bash[35193]: audit 2024-02-17T23:18:07.847840+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/2982577173,v1:172.21.15.80:6817/2982577173]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:18:09.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:08 smithi005 bash[35193]: audit 2024-02-17T23:18:07.848277+0000 mon.a (mon.0) 463 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:18:09.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:08 smithi005 bash[38535]: cluster 2024-02-17T23:18:07.680136+0000 mgr.y (mgr.14140) 139 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean+wait; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:09.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:08 smithi005 bash[38535]: audit 2024-02-17T23:18:07.847840+0000 mon.b (mon.2) 17 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/2982577173,v1:172.21.15.80:6817/2982577173]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:18:09.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:08 smithi005 bash[38535]: audit 2024-02-17T23:18:07.848277+0000 mon.a (mon.0) 463 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:18:10.124 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:09 smithi080 bash[41341]: debug 2024-02-17T23:18:09.773+0000 7feaaf7d4700 -1 osd.6 0 waiting for initial osdmap 2024-02-17T23:18:10.124 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:18:09 smithi080 bash[41341]: debug 2024-02-17T23:18:09.778+0000 7feaba9f0700 -1 osd.6 44 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-17T23:18:10.124 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:09 smithi080 bash[35203]: audit 2024-02-17T23:18:08.757038+0000 mon.a (mon.0) 464 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-17T23:18:10.124 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:09 smithi080 bash[35203]: cluster 2024-02-17T23:18:08.757101+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e43: 7 total, 6 up, 6 in 2024-02-17T23:18:10.124 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:09 smithi080 bash[35203]: audit 2024-02-17T23:18:08.757634+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:10.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:09 smithi080 bash[35203]: audit 2024-02-17T23:18:08.761929+0000 mon.b (mon.2) 18 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/2982577173,v1:172.21.15.80:6817/2982577173]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:10.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:09 smithi080 bash[35203]: audit 2024-02-17T23:18:08.765638+0000 mon.a (mon.0) 467 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:10.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:09 smithi080 bash[35203]: cluster 2024-02-17T23:18:08.831478+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:18:10.125 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:09 smithi080 bash[35203]: cluster 2024-02-17T23:18:08.831534+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[35193]: audit 2024-02-17T23:18:08.757038+0000 mon.a (mon.0) 464 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[35193]: cluster 2024-02-17T23:18:08.757101+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e43: 7 total, 6 up, 6 in 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[35193]: audit 2024-02-17T23:18:08.757634+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[35193]: audit 2024-02-17T23:18:08.761929+0000 mon.b (mon.2) 18 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/2982577173,v1:172.21.15.80:6817/2982577173]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[35193]: audit 2024-02-17T23:18:08.765638+0000 mon.a (mon.0) 467 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[35193]: cluster 2024-02-17T23:18:08.831478+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[35193]: cluster 2024-02-17T23:18:08.831534+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[38535]: audit 2024-02-17T23:18:08.757038+0000 mon.a (mon.0) 464 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[38535]: cluster 2024-02-17T23:18:08.757101+0000 mon.a (mon.0) 465 : cluster [DBG] osdmap e43: 7 total, 6 up, 6 in 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[38535]: audit 2024-02-17T23:18:08.757634+0000 mon.a (mon.0) 466 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:10.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[38535]: audit 2024-02-17T23:18:08.761929+0000 mon.b (mon.2) 18 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/2982577173,v1:172.21.15.80:6817/2982577173]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:10.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[38535]: audit 2024-02-17T23:18:08.765638+0000 mon.a (mon.0) 467 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:10.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[38535]: cluster 2024-02-17T23:18:08.831478+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:18:10.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:09 smithi005 bash[38535]: cluster 2024-02-17T23:18:08.831534+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:18:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:10 smithi005 bash[35193]: cluster 2024-02-17T23:18:09.680400+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean+wait; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:10 smithi005 bash[35193]: audit 2024-02-17T23:18:09.771659+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:18:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:10 smithi005 bash[35193]: cluster 2024-02-17T23:18:09.771703+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e44: 7 total, 6 up, 6 in 2024-02-17T23:18:11.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:10 smithi005 bash[35193]: audit 2024-02-17T23:18:09.772054+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:11.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:10 smithi005 bash[38535]: cluster 2024-02-17T23:18:09.680400+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean+wait; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:10 smithi005 bash[38535]: audit 2024-02-17T23:18:09.771659+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:18:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:10 smithi005 bash[38535]: cluster 2024-02-17T23:18:09.771703+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e44: 7 total, 6 up, 6 in 2024-02-17T23:18:11.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:10 smithi005 bash[38535]: audit 2024-02-17T23:18:09.772054+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:11.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:10 smithi080 bash[35203]: cluster 2024-02-17T23:18:09.680400+0000 mgr.y (mgr.14140) 140 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean+wait; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:10 smithi080 bash[35203]: audit 2024-02-17T23:18:09.771659+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:18:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:10 smithi080 bash[35203]: cluster 2024-02-17T23:18:09.771703+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e44: 7 total, 6 up, 6 in 2024-02-17T23:18:11.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:10 smithi080 bash[35203]: audit 2024-02-17T23:18:09.772054+0000 mon.a (mon.0) 470 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:11.900 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[40758]: debug 2024-02-17T23:18:11.776+0000 7f7b11872700 -1 osd.5 46 build_incremental_map_msg missing incremental map 46 2024-02-17T23:18:11.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[35203]: cluster 2024-02-17T23:18:10.776124+0000 mon.a (mon.0) 471 : cluster [INF] osd.6 [v2:172.21.15.80:6816/2982577173,v1:172.21.15.80:6817/2982577173] boot 2024-02-17T23:18:11.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[35203]: cluster 2024-02-17T23:18:10.776178+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-02-17T23:18:11.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[35203]: audit 2024-02-17T23:18:10.776407+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:11.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[35203]: audit 2024-02-17T23:18:11.000454+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:11.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[35203]: audit 2024-02-17T23:18:11.186439+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:11.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[35203]: audit 2024-02-17T23:18:11.190506+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:11.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[35203]: audit 2024-02-17T23:18:11.192326+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:11.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[35203]: audit 2024-02-17T23:18:11.427050+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:18:11.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[35203]: audit 2024-02-17T23:18:11.427860+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:11.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:11 smithi080 bash[35203]: audit 2024-02-17T23:18:11.429073+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[35193]: cluster 2024-02-17T23:18:10.776124+0000 mon.a (mon.0) 471 : cluster [INF] osd.6 [v2:172.21.15.80:6816/2982577173,v1:172.21.15.80:6817/2982577173] boot 2024-02-17T23:18:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[35193]: cluster 2024-02-17T23:18:10.776178+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-02-17T23:18:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[35193]: audit 2024-02-17T23:18:10.776407+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[35193]: audit 2024-02-17T23:18:11.000454+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:12.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[38535]: cluster 2024-02-17T23:18:10.776124+0000 mon.a (mon.0) 471 : cluster [INF] osd.6 [v2:172.21.15.80:6816/2982577173,v1:172.21.15.80:6817/2982577173] boot 2024-02-17T23:18:12.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[38535]: cluster 2024-02-17T23:18:10.776178+0000 mon.a (mon.0) 472 : cluster [DBG] osdmap e45: 7 total, 7 up, 7 in 2024-02-17T23:18:12.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[38535]: audit 2024-02-17T23:18:10.776407+0000 mon.a (mon.0) 473 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:18:12.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[38535]: audit 2024-02-17T23:18:11.000454+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:12.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[35193]: audit 2024-02-17T23:18:11.186439+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:12.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[38535]: audit 2024-02-17T23:18:11.186439+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:12.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[35193]: audit 2024-02-17T23:18:11.190506+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:12.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[35193]: audit 2024-02-17T23:18:11.192326+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:12.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[35193]: audit 2024-02-17T23:18:11.427050+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:18:12.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[35193]: audit 2024-02-17T23:18:11.427860+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:12.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[35193]: audit 2024-02-17T23:18:11.429073+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[38535]: audit 2024-02-17T23:18:11.190506+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693401\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693501\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693542\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:04.693578\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:04.693675\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[38535]: audit 2024-02-17T23:18:11.192326+0000 mon.a (mon.0) 477 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:12.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[38535]: audit 2024-02-17T23:18:11.427050+0000 mon.a (mon.0) 478 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-02-17T23:18:12.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[38535]: audit 2024-02-17T23:18:11.427860+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:12.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:11 smithi005 bash[38535]: audit 2024-02-17T23:18:11.429073+0000 mon.a (mon.0) 480 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:12.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:12 smithi080 bash[35203]: cluster 2024-02-17T23:18:11.191268+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean+wait; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:12.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:12 smithi080 bash[35203]: audit 2024-02-17T23:18:11.426011+0000 mgr.y (mgr.14140) 142 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:12.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:12 smithi080 bash[35203]: cephadm 2024-02-17T23:18:11.426728+0000 mgr.y (mgr.14140) 143 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:18:12.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:12 smithi080 bash[35203]: cluster 2024-02-17T23:18:11.777861+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2024-02-17T23:18:12.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:12 smithi080 bash[35203]: cluster 2024-02-17T23:18:12.187714+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: 1 stray daemons(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-17T23:18:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:12 smithi005 bash[35193]: cluster 2024-02-17T23:18:11.191268+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean+wait; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:12 smithi005 bash[35193]: audit 2024-02-17T23:18:11.426011+0000 mgr.y (mgr.14140) 142 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:12 smithi005 bash[35193]: cephadm 2024-02-17T23:18:11.426728+0000 mgr.y (mgr.14140) 143 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:18:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:12 smithi005 bash[35193]: cluster 2024-02-17T23:18:11.777861+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2024-02-17T23:18:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:12 smithi005 bash[35193]: cluster 2024-02-17T23:18:12.187714+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: 1 stray daemons(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-17T23:18:13.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:12 smithi005 bash[38535]: cluster 2024-02-17T23:18:11.191268+0000 mgr.y (mgr.14140) 141 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean+wait; 0 B data, 2.3 MiB used, 530 GiB / 536 GiB avail 2024-02-17T23:18:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:12 smithi005 bash[38535]: audit 2024-02-17T23:18:11.426011+0000 mgr.y (mgr.14140) 142 : audit [DBG] from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi080:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:12 smithi005 bash[38535]: cephadm 2024-02-17T23:18:11.426728+0000 mgr.y (mgr.14140) 143 : cephadm [INF] Applying osd on host smithi080... 2024-02-17T23:18:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:12 smithi005 bash[38535]: cluster 2024-02-17T23:18:11.777861+0000 mon.a (mon.0) 481 : cluster [DBG] osdmap e46: 7 total, 7 up, 7 in 2024-02-17T23:18:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:12 smithi005 bash[38535]: cluster 2024-02-17T23:18:12.187714+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: 1 stray daemons(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-17T23:18:15.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[35193]: cluster 2024-02-17T23:18:13.191822+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:15.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[35193]: cluster 2024-02-17T23:18:13.781650+0000 mon.a (mon.0) 483 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-17T23:18:15.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[38535]: cluster 2024-02-17T23:18:13.191822+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:15.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[38535]: cluster 2024-02-17T23:18:13.781650+0000 mon.a (mon.0) 483 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-17T23:18:15.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[35193]: audit 2024-02-17T23:18:13.962789+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:13.962065\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:15.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[38535]: audit 2024-02-17T23:18:13.962789+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:13.962065\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:15.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[35193]: audit 2024-02-17T23:18:13.965842+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:13.962065\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:15.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[35193]: audit 2024-02-17T23:18:14.244450+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.80:0/442064113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14e72964-304a-427b-bfcf-cd0f7188c969"}]: dispatch 2024-02-17T23:18:15.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[38535]: audit 2024-02-17T23:18:13.965842+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:13.962065\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:15.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[38535]: audit 2024-02-17T23:18:14.244450+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.80:0/442064113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14e72964-304a-427b-bfcf-cd0f7188c969"}]: dispatch 2024-02-17T23:18:15.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[35193]: audit 2024-02-17T23:18:14.244945+0000 mon.a (mon.0) 486 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14e72964-304a-427b-bfcf-cd0f7188c969"}]: dispatch 2024-02-17T23:18:15.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[35193]: audit 2024-02-17T23:18:14.249154+0000 mon.a (mon.0) 487 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14e72964-304a-427b-bfcf-cd0f7188c969"}]': finished 2024-02-17T23:18:15.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[35193]: cluster 2024-02-17T23:18:14.249200+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2024-02-17T23:18:15.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[35193]: audit 2024-02-17T23:18:14.249317+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:15.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[38535]: audit 2024-02-17T23:18:14.244945+0000 mon.a (mon.0) 486 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14e72964-304a-427b-bfcf-cd0f7188c969"}]: dispatch 2024-02-17T23:18:15.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[38535]: audit 2024-02-17T23:18:14.249154+0000 mon.a (mon.0) 487 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14e72964-304a-427b-bfcf-cd0f7188c969"}]': finished 2024-02-17T23:18:15.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[38535]: cluster 2024-02-17T23:18:14.249200+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2024-02-17T23:18:15.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:14 smithi005 bash[38535]: audit 2024-02-17T23:18:14.249317+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:14 smithi080 bash[35203]: cluster 2024-02-17T23:18:13.191822+0000 mgr.y (mgr.14140) 144 : cluster [DBG] pgmap v149: 1 pgs: 1 peering; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:14 smithi080 bash[35203]: cluster 2024-02-17T23:18:13.781650+0000 mon.a (mon.0) 483 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-17T23:18:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:14 smithi080 bash[35203]: audit 2024-02-17T23:18:13.962789+0000 mon.a (mon.0) 484 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:13.962065\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:14 smithi080 bash[35203]: audit 2024-02-17T23:18:13.965842+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}}, \"last_daemon_update\": \"2024-02-17T23:18:13.962065\", \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:14 smithi080 bash[35203]: audit 2024-02-17T23:18:14.244450+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.80:0/442064113' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14e72964-304a-427b-bfcf-cd0f7188c969"}]: dispatch 2024-02-17T23:18:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:14 smithi080 bash[35203]: audit 2024-02-17T23:18:14.244945+0000 mon.a (mon.0) 486 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14e72964-304a-427b-bfcf-cd0f7188c969"}]: dispatch 2024-02-17T23:18:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:14 smithi080 bash[35203]: audit 2024-02-17T23:18:14.249154+0000 mon.a (mon.0) 487 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14e72964-304a-427b-bfcf-cd0f7188c969"}]': finished 2024-02-17T23:18:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:14 smithi080 bash[35203]: cluster 2024-02-17T23:18:14.249200+0000 mon.a (mon.0) 488 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2024-02-17T23:18:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:14 smithi080 bash[35203]: audit 2024-02-17T23:18:14.249317+0000 mon.a (mon.0) 489 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:15 smithi005 bash[35193]: cluster 2024-02-17T23:18:13.966571+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v150: 1 pgs: 1 peering; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:15 smithi005 bash[35193]: cluster 2024-02-17T23:18:14.964144+0000 mon.a (mon.0) 490 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemons(s) not managed by cephadm) 2024-02-17T23:18:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:15 smithi005 bash[35193]: audit 2024-02-17T23:18:15.020562+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.15.80:0/2323937773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:18:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:15 smithi005 bash[38535]: cluster 2024-02-17T23:18:13.966571+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v150: 1 pgs: 1 peering; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:15 smithi005 bash[38535]: cluster 2024-02-17T23:18:14.964144+0000 mon.a (mon.0) 490 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemons(s) not managed by cephadm) 2024-02-17T23:18:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:15 smithi005 bash[38535]: audit 2024-02-17T23:18:15.020562+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.15.80:0/2323937773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:18:16.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:15 smithi080 bash[35203]: cluster 2024-02-17T23:18:13.966571+0000 mgr.y (mgr.14140) 145 : cluster [DBG] pgmap v150: 1 pgs: 1 peering; 0 B data, 2.9 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:16.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:15 smithi080 bash[35203]: cluster 2024-02-17T23:18:14.964144+0000 mon.a (mon.0) 490 : cluster [INF] Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemons(s) not managed by cephadm) 2024-02-17T23:18:16.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:15 smithi080 bash[35203]: audit 2024-02-17T23:18:15.020562+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.15.80:0/2323937773' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-02-17T23:18:17.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:17 smithi080 bash[35203]: cluster 2024-02-17T23:18:15.967036+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v152: 1 pgs: 1 peering; 0 B data, 3.0 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:17.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:17 smithi080 bash[35203]: audit 2024-02-17T23:18:17.622722+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:17 smithi005 bash[35193]: cluster 2024-02-17T23:18:15.967036+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v152: 1 pgs: 1 peering; 0 B data, 3.0 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:17 smithi005 bash[35193]: audit 2024-02-17T23:18:17.622722+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:18.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:17 smithi005 bash[38535]: cluster 2024-02-17T23:18:15.967036+0000 mgr.y (mgr.14140) 146 : cluster [DBG] pgmap v152: 1 pgs: 1 peering; 0 B data, 3.0 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:18.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:17 smithi005 bash[38535]: audit 2024-02-17T23:18:17.622722+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:20.118 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:19 smithi080 bash[35203]: cluster 2024-02-17T23:18:17.967466+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:20.119 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:19 smithi080 bash[35203]: cluster 2024-02-17T23:18:18.671386+0000 mon.a (mon.0) 492 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-17T23:18:20.119 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:19 smithi080 bash[35203]: cluster 2024-02-17T23:18:18.671467+0000 mon.a (mon.0) 493 : cluster [INF] Cluster is now healthy 2024-02-17T23:18:20.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:19 smithi005 bash[35193]: cluster 2024-02-17T23:18:17.967466+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:20.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:19 smithi005 bash[35193]: cluster 2024-02-17T23:18:18.671386+0000 mon.a (mon.0) 492 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-17T23:18:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:19 smithi005 bash[35193]: cluster 2024-02-17T23:18:18.671467+0000 mon.a (mon.0) 493 : cluster [INF] Cluster is now healthy 2024-02-17T23:18:20.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:19 smithi005 bash[38535]: cluster 2024-02-17T23:18:17.967466+0000 mgr.y (mgr.14140) 147 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:20.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:19 smithi005 bash[38535]: cluster 2024-02-17T23:18:18.671386+0000 mon.a (mon.0) 492 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-02-17T23:18:20.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:19 smithi005 bash[38535]: cluster 2024-02-17T23:18:18.671467+0000 mon.a (mon.0) 493 : cluster [INF] Cluster is now healthy 2024-02-17T23:18:20.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:20 smithi080 bash[35203]: audit 2024-02-17T23:18:20.460255+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-17T23:18:20.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:20 smithi080 bash[35203]: audit 2024-02-17T23:18:20.461067+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:20.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:20 smithi080 bash[35203]: audit 2024-02-17T23:18:20.461942+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-17T23:18:21.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:20 smithi005 bash[35193]: audit 2024-02-17T23:18:20.460255+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-17T23:18:21.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:20 smithi005 bash[35193]: audit 2024-02-17T23:18:20.461067+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:21.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:20 smithi005 bash[35193]: audit 2024-02-17T23:18:20.461942+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-17T23:18:21.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:20 smithi005 bash[38535]: audit 2024-02-17T23:18:20.460255+0000 mon.a (mon.0) 494 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-17T23:18:21.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:20 smithi005 bash[38535]: audit 2024-02-17T23:18:20.461067+0000 mon.a (mon.0) 495 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:21.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:20 smithi005 bash[38535]: audit 2024-02-17T23:18:20.461942+0000 mon.a (mon.0) 496 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2024-02-17T23:18:22.023 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:21 smithi080 bash[35203]: cluster 2024-02-17T23:18:19.967937+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:22.024 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:21 smithi080 bash[35203]: cephadm 2024-02-17T23:18:20.461641+0000 mgr.y (mgr.14140) 149 : cephadm [INF] Deploying daemon osd.7 on smithi080 2024-02-17T23:18:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:21 smithi005 bash[35193]: cluster 2024-02-17T23:18:19.967937+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:21 smithi005 bash[35193]: cephadm 2024-02-17T23:18:20.461641+0000 mgr.y (mgr.14140) 149 : cephadm [INF] Deploying daemon osd.7 on smithi080 2024-02-17T23:18:22.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:21 smithi005 bash[38535]: cluster 2024-02-17T23:18:19.967937+0000 mgr.y (mgr.14140) 148 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:22.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:21 smithi005 bash[38535]: cephadm 2024-02-17T23:18:20.461641+0000 mgr.y (mgr.14140) 149 : cephadm [INF] Deploying daemon osd.7 on smithi080 2024-02-17T23:18:22.342 INFO:teuthology.orchestra.run.smithi080.stdout:Created osd(s) 7 on host 'smithi080' 2024-02-17T23:18:23.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:22 smithi005 bash[35193]: audit 2024-02-17T23:18:22.334453+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:23.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:22 smithi005 bash[35193]: audit 2024-02-17T23:18:22.334971+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:23.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:22 smithi005 bash[35193]: audit 2024-02-17T23:18:22.337717+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:23.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:22 smithi005 bash[38535]: audit 2024-02-17T23:18:22.334453+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:23.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:22 smithi005 bash[38535]: audit 2024-02-17T23:18:22.334971+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:23.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:22 smithi005 bash[38535]: audit 2024-02-17T23:18:22.337717+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:23.136 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:22 smithi080 bash[35203]: audit 2024-02-17T23:18:22.334453+0000 mon.a (mon.0) 497 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:23.136 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:22 smithi080 bash[35203]: audit 2024-02-17T23:18:22.334971+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:23.136 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:22 smithi080 bash[35203]: audit 2024-02-17T23:18:22.337717+0000 mon.a (mon.0) 499 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961766\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961862\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961902\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961938\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:13.961972\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_device_update\": \"2024-02-17T23:18:11.185766\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:23.149 DEBUG:teuthology.orchestra.run.smithi080:osd.7> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.7.service 2024-02-17T23:18:23.152 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-02-17T23:18:23.152 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd stat -f json 2024-02-17T23:18:23.182 INFO:journalctl@ceph.osd.7.smithi080.stdout:-- Logs begin at Sat 2024-02-17 23:05:17 UTC. -- 2024-02-17T23:18:23.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:23 smithi005 bash[35193]: cluster 2024-02-17T23:18:21.968343+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:23.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:23 smithi005 bash[38535]: cluster 2024-02-17T23:18:21.968343+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:23.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:23 smithi080 bash[35203]: cluster 2024-02-17T23:18:21.968343+0000 mgr.y (mgr.14140) 150 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:23.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:23 smithi080 bash[42676]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-17T23:18:23.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:23 smithi080 bash[42676]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2024-02-17T23:18:23.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:23 smithi080 bash[42676]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2024-02-17T23:18:23.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:23 smithi080 bash[42676]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2024-02-17T23:18:23.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:23 smithi080 bash[42676]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-17T23:18:23.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:23 smithi080 bash[42676]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-17T23:18:23.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:23 smithi080 bash[42676]: --> ceph-volume lvm activate successful for osd ID: 7 2024-02-17T23:18:24.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:24 smithi080 bash[35203]: audit 2024-02-17T23:18:23.696773+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-17T23:18:24.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:24 smithi080 bash[35203]: audit 2024-02-17T23:18:23.699187+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-17T23:18:24.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:24 smithi005 bash[35193]: audit 2024-02-17T23:18:23.696773+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-17T23:18:24.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:24 smithi005 bash[35193]: audit 2024-02-17T23:18:23.699187+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-17T23:18:24.984 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:24 smithi005 bash[38535]: audit 2024-02-17T23:18:23.696773+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-17T23:18:24.984 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:24 smithi005 bash[38535]: audit 2024-02-17T23:18:23.699187+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-17T23:18:25.390 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:25 smithi080 bash[42871]: debug 2024-02-17T23:18:25.256+0000 7f6065439ec0 -1 Falling back to public interface 2024-02-17T23:18:25.418 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:18:25.991 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:25 smithi080 bash[42871]: debug 2024-02-17T23:18:25.827+0000 7f6065439ec0 -1 osd.7 0 log_to_monitors {default=true} 2024-02-17T23:18:25.992 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:25 smithi080 bash[35203]: cluster 2024-02-17T23:18:23.968696+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:25.992 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:25 smithi080 bash[35203]: audit 2024-02-17T23:18:25.417291+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.5:0/873668055' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-17T23:18:25.992 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:25 smithi080 bash[35203]: audit 2024-02-17T23:18:25.591872+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:25.992 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:25 smithi080 bash[35203]: audit 2024-02-17T23:18:25.594522+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:25.992 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:25 smithi080 bash[35203]: audit 2024-02-17T23:18:25.595045+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:26.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:25 smithi005 bash[38535]: cluster 2024-02-17T23:18:23.968696+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:26.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:25 smithi005 bash[38535]: audit 2024-02-17T23:18:25.417291+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.5:0/873668055' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-17T23:18:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:25 smithi005 bash[35193]: cluster 2024-02-17T23:18:23.968696+0000 mgr.y (mgr.14140) 151 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:26.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:25 smithi005 bash[35193]: audit 2024-02-17T23:18:25.417291+0000 mon.c (mon.1) 13 : audit [DBG] from='client.? 172.21.15.5:0/873668055' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-17T23:18:26.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:25 smithi005 bash[35193]: audit 2024-02-17T23:18:25.591872+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:26.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:25 smithi005 bash[38535]: audit 2024-02-17T23:18:25.591872+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:26.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:25 smithi005 bash[35193]: audit 2024-02-17T23:18:25.594522+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:26.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:25 smithi005 bash[35193]: audit 2024-02-17T23:18:25.595045+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:26.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:25 smithi005 bash[38535]: audit 2024-02-17T23:18:25.594522+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"comment\": \"not used by ceph\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:26.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:25 smithi005 bash[38535]: audit 2024-02-17T23:18:25.595045+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2024-02-17T23:18:26.167 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":47,"num_osds":8,"num_up_osds":7,"osd_up_since":1708211890,"num_in_osds":7,"osd_in_since":1708211890,"num_remapped_pgs":0} 2024-02-17T23:18:26.985 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:26 smithi080 bash[35203]: audit 2024-02-17T23:18:25.830834+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/3532387544,v1:172.21.15.80:6825/3532387544]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:18:26.985 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:26 smithi080 bash[35203]: audit 2024-02-17T23:18:25.831191+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:18:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:26 smithi005 bash[35193]: audit 2024-02-17T23:18:25.830834+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/3532387544,v1:172.21.15.80:6825/3532387544]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:18:27.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:26 smithi005 bash[35193]: audit 2024-02-17T23:18:25.831191+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:18:27.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:26 smithi005 bash[38535]: audit 2024-02-17T23:18:25.830834+0000 mon.b (mon.2) 21 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/3532387544,v1:172.21.15.80:6825/3532387544]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:18:27.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:26 smithi005 bash[38535]: audit 2024-02-17T23:18:25.831191+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:18:27.168 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd stat -f json 2024-02-17T23:18:27.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[35193]: cluster 2024-02-17T23:18:25.969215+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:27.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[35193]: audit 2024-02-17T23:18:26.708809+0000 mon.a (mon.0) 506 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-17T23:18:27.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[35193]: cluster 2024-02-17T23:18:26.708850+0000 mon.a (mon.0) 507 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2024-02-17T23:18:27.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[35193]: audit 2024-02-17T23:18:26.709003+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:27.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[35193]: audit 2024-02-17T23:18:26.710668+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/3532387544,v1:172.21.15.80:6825/3532387544]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:27.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[35193]: audit 2024-02-17T23:18:26.710992+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:27.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[35193]: cluster 2024-02-17T23:18:26.787455+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:18:27.869 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[35193]: cluster 2024-02-17T23:18:26.787490+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:18:27.870 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[38535]: cluster 2024-02-17T23:18:25.969215+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:27.870 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[38535]: audit 2024-02-17T23:18:26.708809+0000 mon.a (mon.0) 506 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-17T23:18:27.870 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[38535]: cluster 2024-02-17T23:18:26.708850+0000 mon.a (mon.0) 507 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2024-02-17T23:18:27.870 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[38535]: audit 2024-02-17T23:18:26.709003+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:27.870 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[38535]: audit 2024-02-17T23:18:26.710668+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/3532387544,v1:172.21.15.80:6825/3532387544]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:27.870 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[38535]: audit 2024-02-17T23:18:26.710992+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:27.870 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[38535]: cluster 2024-02-17T23:18:26.787455+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:18:27.870 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:27 smithi005 bash[38535]: cluster 2024-02-17T23:18:26.787490+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:18:28.097 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:27 smithi080 bash[42871]: debug 2024-02-17T23:18:27.710+0000 7f604a1e6700 -1 osd.7 0 waiting for initial osdmap 2024-02-17T23:18:28.097 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:18:27 smithi080 bash[42871]: debug 2024-02-17T23:18:27.718+0000 7f6055402700 -1 osd.7 49 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2024-02-17T23:18:28.097 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:27 smithi080 bash[35203]: cluster 2024-02-17T23:18:25.969215+0000 mgr.y (mgr.14140) 152 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:28.097 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:27 smithi080 bash[35203]: audit 2024-02-17T23:18:26.708809+0000 mon.a (mon.0) 506 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-17T23:18:28.097 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:27 smithi080 bash[35203]: cluster 2024-02-17T23:18:26.708850+0000 mon.a (mon.0) 507 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2024-02-17T23:18:28.098 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:27 smithi080 bash[35203]: audit 2024-02-17T23:18:26.709003+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:28.098 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:27 smithi080 bash[35203]: audit 2024-02-17T23:18:26.710668+0000 mon.b (mon.2) 22 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/3532387544,v1:172.21.15.80:6825/3532387544]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:28.098 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:27 smithi080 bash[35203]: audit 2024-02-17T23:18:26.710992+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:18:28.098 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:27 smithi080 bash[35203]: cluster 2024-02-17T23:18:26.787455+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2024-02-17T23:18:28.098 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:27 smithi080 bash[35203]: cluster 2024-02-17T23:18:26.787490+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2024-02-17T23:18:28.855 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:28 smithi005 bash[35193]: audit 2024-02-17T23:18:27.709181+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:18:28.855 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:28 smithi005 bash[35193]: cluster 2024-02-17T23:18:27.709234+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2024-02-17T23:18:28.855 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:28 smithi005 bash[35193]: audit 2024-02-17T23:18:27.709763+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:28.855 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:28 smithi005 bash[38535]: audit 2024-02-17T23:18:27.709181+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:18:28.856 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:28 smithi005 bash[38535]: cluster 2024-02-17T23:18:27.709234+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2024-02-17T23:18:28.856 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:28 smithi005 bash[38535]: audit 2024-02-17T23:18:27.709763+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:29.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:28 smithi080 bash[35203]: audit 2024-02-17T23:18:27.709181+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]': finished 2024-02-17T23:18:29.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:28 smithi080 bash[35203]: cluster 2024-02-17T23:18:27.709234+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e49: 8 total, 7 up, 7 in 2024-02-17T23:18:29.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:28 smithi080 bash[35203]: audit 2024-02-17T23:18:27.709763+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:29.235 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:18:29.911 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[35193]: cluster 2024-02-17T23:18:27.969546+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:29.911 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[35193]: cluster 2024-02-17T23:18:28.710782+0000 mon.a (mon.0) 513 : cluster [INF] osd.7 [v2:172.21.15.80:6824/3532387544,v1:172.21.15.80:6825/3532387544] boot 2024-02-17T23:18:29.911 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[35193]: cluster 2024-02-17T23:18:28.710818+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-17T23:18:29.911 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[35193]: audit 2024-02-17T23:18:28.710960+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:29.912 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[35193]: audit 2024-02-17T23:18:28.769085+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:29.912 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[38535]: cluster 2024-02-17T23:18:27.969546+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:29.912 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[38535]: cluster 2024-02-17T23:18:28.710782+0000 mon.a (mon.0) 513 : cluster [INF] osd.7 [v2:172.21.15.80:6824/3532387544,v1:172.21.15.80:6825/3532387544] boot 2024-02-17T23:18:29.912 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[38535]: cluster 2024-02-17T23:18:28.710818+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-17T23:18:29.912 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[38535]: audit 2024-02-17T23:18:28.710960+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:29.912 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[38535]: audit 2024-02-17T23:18:28.769085+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:29.913 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[35193]: audit 2024-02-17T23:18:28.955137+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:29.913 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[35193]: audit 2024-02-17T23:18:28.957906+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:29.913 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[35193]: audit 2024-02-17T23:18:29.234247+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.5:0/2515960541' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-17T23:18:29.913 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[38535]: audit 2024-02-17T23:18:28.955137+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:29.913 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[38535]: audit 2024-02-17T23:18:28.957906+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:29.914 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:29 smithi005 bash[38535]: audit 2024-02-17T23:18:29.234247+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.5:0/2515960541' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-17T23:18:29.922 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":50,"num_osds":8,"num_up_osds":8,"osd_up_since":1708211908,"num_in_osds":8,"osd_in_since":1708211908,"num_remapped_pgs":0} 2024-02-17T23:18:29.923 INFO:tasks.cephadm:Adding prometheus.a on smithi080 2024-02-17T23:18:29.923 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch apply prometheus '1;smithi080=a' 2024-02-17T23:18:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:29 smithi080 bash[35203]: cluster 2024-02-17T23:18:27.969546+0000 mgr.y (mgr.14140) 153 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 3.1 MiB used, 619 GiB / 626 GiB avail 2024-02-17T23:18:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:29 smithi080 bash[35203]: cluster 2024-02-17T23:18:28.710782+0000 mon.a (mon.0) 513 : cluster [INF] osd.7 [v2:172.21.15.80:6824/3532387544,v1:172.21.15.80:6825/3532387544] boot 2024-02-17T23:18:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:29 smithi080 bash[35203]: cluster 2024-02-17T23:18:28.710818+0000 mon.a (mon.0) 514 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2024-02-17T23:18:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:29 smithi080 bash[35203]: audit 2024-02-17T23:18:28.710960+0000 mon.a (mon.0) 515 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:18:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:29 smithi080 bash[35203]: audit 2024-02-17T23:18:28.769085+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:30.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:29 smithi080 bash[35203]: audit 2024-02-17T23:18:28.955137+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:30.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:29 smithi080 bash[35203]: audit 2024-02-17T23:18:28.957906+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}}, \"last_daemon_update\": \"2024-02-17T23:18:25.591172\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:30.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:29 smithi080 bash[35203]: audit 2024-02-17T23:18:29.234247+0000 mon.c (mon.1) 14 : audit [DBG] from='client.? 172.21.15.5:0/2515960541' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-02-17T23:18:30.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:30 smithi080 bash[35203]: cluster 2024-02-17T23:18:29.718761+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-17T23:18:31.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:30 smithi005 bash[35193]: cluster 2024-02-17T23:18:29.718761+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-17T23:18:31.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:30 smithi005 bash[38535]: cluster 2024-02-17T23:18:29.718761+0000 mon.a (mon.0) 519 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2024-02-17T23:18:31.901 INFO:teuthology.orchestra.run.smithi080.stdout:Scheduled prometheus update... 2024-02-17T23:18:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:31 smithi005 bash[35193]: cluster 2024-02-17T23:18:29.969920+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:32.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:31 smithi005 bash[38535]: cluster 2024-02-17T23:18:29.969920+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:32.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:31 smithi080 bash[35203]: cluster 2024-02-17T23:18:29.969920+0000 mgr.y (mgr.14140) 154 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 3.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:32.582 DEBUG:teuthology.orchestra.run.smithi080:prometheus.a> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@prometheus.a.service 2024-02-17T23:18:32.585 INFO:tasks.cephadm:Adding node-exporter.a on smithi005 2024-02-17T23:18:32.585 INFO:tasks.cephadm:Adding node-exporter.b on smithi080 2024-02-17T23:18:32.585 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch apply node-exporter '2;smithi005=a;smithi080=b' 2024-02-17T23:18:32.613 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:-- Logs begin at Sat 2024-02-17 23:05:17 UTC. -- 2024-02-17T23:18:32.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:32 smithi080 bash[35203]: audit 2024-02-17T23:18:31.892251+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-17T23:18:31.891912\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-02-17T23:18:32.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:32 smithi080 bash[35203]: audit 2024-02-17T23:18:31.895140+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-17T23:18:31.891912\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-02-17T23:18:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:32 smithi005 bash[35193]: audit 2024-02-17T23:18:31.892251+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-17T23:18:31.891912\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-02-17T23:18:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:32 smithi005 bash[35193]: audit 2024-02-17T23:18:31.895140+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-17T23:18:31.891912\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-02-17T23:18:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:32 smithi005 bash[38535]: audit 2024-02-17T23:18:31.892251+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-17T23:18:31.891912\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]: dispatch 2024-02-17T23:18:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:32 smithi005 bash[38535]: audit 2024-02-17T23:18:31.895140+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.prometheus","val":"{\"created\": \"2024-02-17T23:18:31.891912\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"prometheus\"}}"}]': finished 2024-02-17T23:18:33.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:33 smithi080 bash[35203]: audit 2024-02-17T23:18:31.891297+0000 mgr.y (mgr.14140) 155 : audit [DBG] from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:33.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:33 smithi080 bash[35203]: cephadm 2024-02-17T23:18:31.891899+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi080=a 2024-02-17T23:18:33.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:33 smithi080 bash[35203]: cephadm 2024-02-17T23:18:31.898806+0000 mgr.y (mgr.14140) 157 : cephadm [INF] Deploying daemon prometheus.a on smithi080 2024-02-17T23:18:33.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:33 smithi080 bash[35203]: cluster 2024-02-17T23:18:31.970334+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:33 smithi005 bash[35193]: audit 2024-02-17T23:18:31.891297+0000 mgr.y (mgr.14140) 155 : audit [DBG] from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:33 smithi005 bash[35193]: cephadm 2024-02-17T23:18:31.891899+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi080=a 2024-02-17T23:18:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:33 smithi005 bash[35193]: cephadm 2024-02-17T23:18:31.898806+0000 mgr.y (mgr.14140) 157 : cephadm [INF] Deploying daemon prometheus.a on smithi080 2024-02-17T23:18:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:33 smithi005 bash[35193]: cluster 2024-02-17T23:18:31.970334+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:33 smithi005 bash[38535]: audit 2024-02-17T23:18:31.891297+0000 mgr.y (mgr.14140) 155 : audit [DBG] from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:33 smithi005 bash[38535]: cephadm 2024-02-17T23:18:31.891899+0000 mgr.y (mgr.14140) 156 : cephadm [INF] Saving service prometheus spec with placement count:1 smithi080=a 2024-02-17T23:18:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:33 smithi005 bash[38535]: cephadm 2024-02-17T23:18:31.898806+0000 mgr.y (mgr.14140) 157 : cephadm [INF] Deploying daemon prometheus.a on smithi080 2024-02-17T23:18:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:33 smithi005 bash[38535]: cluster 2024-02-17T23:18:31.970334+0000 mgr.y (mgr.14140) 158 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 3.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:34.590 INFO:teuthology.orchestra.run.smithi080.stdout:Scheduled node-exporter update... 2024-02-17T23:18:34.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:34 smithi080 bash[35203]: audit 2024-02-17T23:18:34.585697+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-17T23:18:34.585318\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-02-17T23:18:34.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:34 smithi080 bash[35203]: audit 2024-02-17T23:18:34.588651+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-17T23:18:34.585318\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-02-17T23:18:35.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:34 smithi005 bash[35193]: audit 2024-02-17T23:18:34.585697+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-17T23:18:34.585318\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-02-17T23:18:35.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:34 smithi005 bash[35193]: audit 2024-02-17T23:18:34.588651+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-17T23:18:34.585318\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-02-17T23:18:35.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:34 smithi005 bash[38535]: audit 2024-02-17T23:18:34.585697+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-17T23:18:34.585318\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]: dispatch 2024-02-17T23:18:35.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:34 smithi005 bash[38535]: audit 2024-02-17T23:18:34.588651+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.node-exporter","val":"{\"created\": \"2024-02-17T23:18:34.585318\", \"spec\": {\"placement\": {\"count\": 2, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}, {\"hostname\": \"smithi080\", \"name\": \"b\", \"network\": \"\"}]}, \"service_type\": \"node-exporter\"}}"}]': finished 2024-02-17T23:18:35.581 DEBUG:teuthology.orchestra.run.smithi005:node-exporter.a> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@node-exporter.a.service 2024-02-17T23:18:35.584 DEBUG:teuthology.orchestra.run.smithi080:node-exporter.b> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@node-exporter.b.service 2024-02-17T23:18:35.587 INFO:tasks.cephadm:Adding alertmanager.a on smithi005 2024-02-17T23:18:35.587 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch apply alertmanager '1;smithi005=a' 2024-02-17T23:18:35.618 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:-- Logs begin at Sat 2024-02-17 23:05:17 UTC. -- 2024-02-17T23:18:35.621 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:-- Logs begin at Sat 2024-02-17 23:05:20 UTC. -- 2024-02-17T23:18:35.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:35 smithi005 bash[35193]: cluster 2024-02-17T23:18:33.970798+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:35.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:35 smithi005 bash[35193]: audit 2024-02-17T23:18:34.584679+0000 mgr.y (mgr.14140) 160 : audit [DBG] from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi005=a;smithi080=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:35.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:35 smithi005 bash[35193]: cephadm 2024-02-17T23:18:34.585304+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi005=a,smithi080=b 2024-02-17T23:18:35.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:35 smithi005 bash[38535]: cluster 2024-02-17T23:18:33.970798+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:35.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:35 smithi005 bash[38535]: audit 2024-02-17T23:18:34.584679+0000 mgr.y (mgr.14140) 160 : audit [DBG] from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi005=a;smithi080=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:35.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:35 smithi005 bash[38535]: cephadm 2024-02-17T23:18:34.585304+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi005=a,smithi080=b 2024-02-17T23:18:35.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:35 smithi080 bash[35203]: cluster 2024-02-17T23:18:33.970798+0000 mgr.y (mgr.14140) 159 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:35.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:35 smithi080 bash[35203]: audit 2024-02-17T23:18:34.584679+0000 mgr.y (mgr.14140) 160 : audit [DBG] from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi005=a;smithi080=b", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:35.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:35 smithi080 bash[35203]: cephadm 2024-02-17T23:18:34.585304+0000 mgr.y (mgr.14140) 161 : cephadm [INF] Saving service node-exporter spec with placement count:2 smithi005=a,smithi080=b 2024-02-17T23:18:37.610 INFO:teuthology.orchestra.run.smithi080.stdout:Scheduled alertmanager update... 2024-02-17T23:18:37.961 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:37 smithi080 bash[35203]: cluster 2024-02-17T23:18:35.971253+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:37.961 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:37 smithi080 bash[35203]: audit 2024-02-17T23:18:37.605510+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-17T23:18:37.605184\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-02-17T23:18:37.961 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:37 smithi080 bash[35203]: audit 2024-02-17T23:18:37.608735+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-17T23:18:37.605184\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-02-17T23:18:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:37 smithi005 bash[35193]: cluster 2024-02-17T23:18:35.971253+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:37 smithi005 bash[35193]: audit 2024-02-17T23:18:37.605510+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-17T23:18:37.605184\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-02-17T23:18:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:37 smithi005 bash[35193]: audit 2024-02-17T23:18:37.608735+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-17T23:18:37.605184\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-02-17T23:18:38.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:37 smithi005 bash[38535]: cluster 2024-02-17T23:18:35.971253+0000 mgr.y (mgr.14140) 162 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:38.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:37 smithi005 bash[38535]: audit 2024-02-17T23:18:37.605510+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-17T23:18:37.605184\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]: dispatch 2024-02-17T23:18:38.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:37 smithi005 bash[38535]: audit 2024-02-17T23:18:37.608735+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.alertmanager","val":"{\"created\": \"2024-02-17T23:18:37.605184\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi005\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"alertmanager\"}}"}]': finished 2024-02-17T23:18:38.311 DEBUG:teuthology.orchestra.run.smithi005:alertmanager.a> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@alertmanager.a.service 2024-02-17T23:18:38.314 INFO:tasks.cephadm:Adding grafana.a on smithi080 2024-02-17T23:18:38.315 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph orch apply grafana '1;smithi080=a' 2024-02-17T23:18:38.348 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:-- Logs begin at Sat 2024-02-17 23:05:20 UTC. -- 2024-02-17T23:18:39.013 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:38 smithi080 bash[35203]: audit 2024-02-17T23:18:37.604576+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi005=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:39.014 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:38 smithi080 bash[35203]: cephadm 2024-02-17T23:18:37.605170+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi005=a 2024-02-17T23:18:39.014 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:38 smithi080 bash[35203]: audit 2024-02-17T23:18:38.700197+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}, {\"id\": \"27c55811-6c4e-4a42-9c84-9eea97348c63\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708211908.7108374, \"finished_at\": 1708211918.6768312}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-17T23:18:39.014 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:38 smithi080 bash[35203]: audit 2024-02-17T23:18:38.703035+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}, {\"id\": \"27c55811-6c4e-4a42-9c84-9eea97348c63\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708211908.7108374, \"finished_at\": 1708211918.6768312}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-17T23:18:39.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:38 smithi005 bash[35193]: audit 2024-02-17T23:18:37.604576+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi005=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:39.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:38 smithi005 bash[35193]: cephadm 2024-02-17T23:18:37.605170+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi005=a 2024-02-17T23:18:39.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:38 smithi005 bash[35193]: audit 2024-02-17T23:18:38.700197+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}, {\"id\": \"27c55811-6c4e-4a42-9c84-9eea97348c63\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708211908.7108374, \"finished_at\": 1708211918.6768312}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-17T23:18:39.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:38 smithi005 bash[35193]: audit 2024-02-17T23:18:38.703035+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}, {\"id\": \"27c55811-6c4e-4a42-9c84-9eea97348c63\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708211908.7108374, \"finished_at\": 1708211918.6768312}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-17T23:18:39.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:38 smithi005 bash[38535]: audit 2024-02-17T23:18:37.604576+0000 mgr.y (mgr.14140) 163 : audit [DBG] from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi005=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:39.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:38 smithi005 bash[38535]: cephadm 2024-02-17T23:18:37.605170+0000 mgr.y (mgr.14140) 164 : cephadm [INF] Saving service alertmanager spec with placement count:1 smithi005=a 2024-02-17T23:18:39.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:38 smithi005 bash[38535]: audit 2024-02-17T23:18:38.700197+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}, {\"id\": \"27c55811-6c4e-4a42-9c84-9eea97348c63\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708211908.7108374, \"finished_at\": 1708211918.6768312}], \"version\": 2, \"compat_version\": 2}"}]: dispatch 2024-02-17T23:18:39.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:38 smithi005 bash[38535]: audit 2024-02-17T23:18:38.703035+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/progress/completed","val":"{\"events\": [{\"id\": \"9b689722-2f95-457e-9a31-449242c294ed\", \"message\": \"Rebalancing after osd.4 marked in\", \"refs\": [[\"osd\", 4]], \"started_at\": 1708211846.682153, \"finished_at\": 1708211857.8269687}, {\"id\": \"1fa05837-2487-4020-8d08-168e4ab20cf5\", \"message\": \"Rebalancing after osd.6 marked in\", \"refs\": [[\"osd\", 6]], \"started_at\": 1708211890.7757854, \"finished_at\": 1708211902.344855}, {\"id\": \"27c55811-6c4e-4a42-9c84-9eea97348c63\", \"message\": \"Rebalancing after osd.7 marked in\", \"refs\": [[\"osd\", 7]], \"started_at\": 1708211908.7108374, \"finished_at\": 1708211918.6768312}], \"version\": 2, \"compat_version\": 2}"}]': finished 2024-02-17T23:18:39.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:39 smithi080 bash[35203]: cluster 2024-02-17T23:18:37.971661+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:40.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:39 smithi005 bash[35193]: cluster 2024-02-17T23:18:37.971661+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:40.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:39 smithi005 bash[38535]: cluster 2024-02-17T23:18:37.971661+0000 mgr.y (mgr.14140) 165 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:40.950 INFO:teuthology.orchestra.run.smithi080.stdout:Scheduled grafana update... 2024-02-17T23:18:42.098 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:41 smithi080 bash[35203]: cluster 2024-02-17T23:18:39.972194+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:42.099 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:41 smithi080 bash[35203]: audit 2024-02-17T23:18:40.945642+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-17T23:18:40.945239\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-02-17T23:18:42.099 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:41 smithi080 bash[35203]: audit 2024-02-17T23:18:40.948400+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-17T23:18:40.945239\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-02-17T23:18:42.108 DEBUG:teuthology.orchestra.run.smithi080:grafana.a> sudo journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@grafana.a.service 2024-02-17T23:18:42.110 INFO:tasks.cephadm:Setting up client nodes... 2024-02-17T23:18:42.111 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-17T23:18:42.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:41 smithi005 bash[35193]: cluster 2024-02-17T23:18:39.972194+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:41 smithi005 bash[35193]: audit 2024-02-17T23:18:40.945642+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-17T23:18:40.945239\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-02-17T23:18:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:41 smithi005 bash[35193]: audit 2024-02-17T23:18:40.948400+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-17T23:18:40.945239\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-02-17T23:18:42.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:41 smithi005 bash[38535]: cluster 2024-02-17T23:18:39.972194+0000 mgr.y (mgr.14140) 166 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:42.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:41 smithi005 bash[38535]: audit 2024-02-17T23:18:40.945642+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-17T23:18:40.945239\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]: dispatch 2024-02-17T23:18:42.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:41 smithi005 bash[38535]: audit 2024-02-17T23:18:40.948400+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.grafana","val":"{\"created\": \"2024-02-17T23:18:40.945239\", \"spec\": {\"placement\": {\"count\": 1, \"hosts\": [{\"hostname\": \"smithi080\", \"name\": \"a\", \"network\": \"\"}]}, \"service_type\": \"grafana\"}}"}]': finished 2024-02-17T23:18:42.142 INFO:journalctl@ceph.grafana.a.smithi080.stdout:-- Logs begin at Sat 2024-02-17 23:05:17 UTC. -- 2024-02-17T23:18:42.759 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:42 smithi005 bash[38535]: audit 2024-02-17T23:18:40.944592+0000 mgr.y (mgr.14140) 167 : audit [DBG] from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:42.759 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:42 smithi005 bash[38535]: cephadm 2024-02-17T23:18:40.945219+0000 mgr.y (mgr.14140) 168 : cephadm [INF] Saving service grafana spec with placement count:1 smithi080=a 2024-02-17T23:18:43.093 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:42 smithi005 bash[35193]: audit 2024-02-17T23:18:40.944592+0000 mgr.y (mgr.14140) 167 : audit [DBG] from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:43.094 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:42 smithi005 bash[35193]: cephadm 2024-02-17T23:18:40.945219+0000 mgr.y (mgr.14140) 168 : cephadm [INF] Saving service grafana spec with placement count:1 smithi080=a 2024-02-17T23:18:43.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:42 smithi080 bash[35203]: audit 2024-02-17T23:18:40.944592+0000 mgr.y (mgr.14140) 167 : audit [DBG] from='client.34334 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi080=a", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:18:43.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:42 smithi080 bash[35203]: cephadm 2024-02-17T23:18:40.945219+0000 mgr.y (mgr.14140) 168 : cephadm [INF] Saving service grafana spec with placement count:1 smithi080=a 2024-02-17T23:18:43.907 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:43 smithi005 bash[35193]: cluster 2024-02-17T23:18:41.972503+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:43.907 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:43 smithi005 bash[38535]: cluster 2024-02-17T23:18:41.972503+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:44.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:43 smithi080 bash[35203]: cluster 2024-02-17T23:18:41.972503+0000 mgr.y (mgr.14140) 169 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:44.368 INFO:teuthology.orchestra.run.smithi005.stdout:[client.0] 2024-02-17T23:18:44.368 INFO:teuthology.orchestra.run.smithi005.stdout: key = AQDUPtFlnf+wFRAAhugyskZJOTJhi5alDf2zlQ== 2024-02-17T23:18:45.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:44 smithi005 bash[35193]: audit 2024-02-17T23:18:44.363794+0000 mon.a (mon.0) 530 : audit [INF] from='client.? 172.21.15.5:0/253953327' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-17T23:18:45.116 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:44 smithi005 bash[35193]: audit 2024-02-17T23:18:44.366972+0000 mon.a (mon.0) 531 : audit [INF] from='client.? 172.21.15.5:0/253953327' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-17T23:18:45.116 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:44 smithi005 bash[38535]: audit 2024-02-17T23:18:44.363794+0000 mon.a (mon.0) 530 : audit [INF] from='client.? 172.21.15.5:0/253953327' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-17T23:18:45.116 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:44 smithi005 bash[38535]: audit 2024-02-17T23:18:44.366972+0000 mon.a (mon.0) 531 : audit [INF] from='client.? 172.21.15.5:0/253953327' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-17T23:18:45.129 DEBUG:teuthology.orchestra.run.smithi005:> set -ex 2024-02-17T23:18:45.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-02-17T23:18:45.129 DEBUG:teuthology.orchestra.run.smithi005:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-02-17T23:18:45.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:44 smithi080 bash[35203]: audit 2024-02-17T23:18:44.363794+0000 mon.a (mon.0) 530 : audit [INF] from='client.? 172.21.15.5:0/253953327' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-17T23:18:45.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:44 smithi080 bash[35203]: audit 2024-02-17T23:18:44.366972+0000 mon.a (mon.0) 531 : audit [INF] from='client.? 172.21.15.5:0/253953327' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-17T23:18:45.214 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-02-17T23:18:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:45 smithi005 bash[35193]: cluster 2024-02-17T23:18:43.973043+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:45 smithi005 bash[38535]: cluster 2024-02-17T23:18:43.973043+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:46.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:45 smithi080 bash[35203]: cluster 2024-02-17T23:18:43.973043+0000 mgr.y (mgr.14140) 170 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:48.058 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:47 smithi080 bash[35203]: cluster 2024-02-17T23:18:45.973575+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:47 smithi005 bash[35193]: cluster 2024-02-17T23:18:45.973575+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:47 smithi005 bash[38535]: cluster 2024-02-17T23:18:45.973575+0000 mgr.y (mgr.14140) 171 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:49.492 INFO:teuthology.orchestra.run.smithi080.stdout:[client.1] 2024-02-17T23:18:49.492 INFO:teuthology.orchestra.run.smithi080.stdout: key = AQDZPtFlYkMLHRAAiWXY/wdZ7cEmSdzyjdIBuA== 2024-02-17T23:18:49.787 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:49 smithi080 bash[35203]: cluster 2024-02-17T23:18:47.974055+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:49.787 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:49 smithi080 bash[35203]: audit 2024-02-17T23:18:49.486530+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.80:0/3053402969' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-17T23:18:49.787 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:49 smithi080 bash[35203]: audit 2024-02-17T23:18:49.487135+0000 mon.a (mon.0) 532 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-17T23:18:49.787 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:49 smithi080 bash[35203]: audit 2024-02-17T23:18:49.490686+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-17T23:18:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:49 smithi005 bash[35193]: cluster 2024-02-17T23:18:47.974055+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:49 smithi005 bash[35193]: audit 2024-02-17T23:18:49.486530+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.80:0/3053402969' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-17T23:18:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:49 smithi005 bash[35193]: audit 2024-02-17T23:18:49.487135+0000 mon.a (mon.0) 532 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-17T23:18:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:49 smithi005 bash[35193]: audit 2024-02-17T23:18:49.490686+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-17T23:18:50.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:49 smithi005 bash[38535]: cluster 2024-02-17T23:18:47.974055+0000 mgr.y (mgr.14140) 172 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:50.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:49 smithi005 bash[38535]: audit 2024-02-17T23:18:49.486530+0000 mon.b (mon.2) 23 : audit [INF] from='client.? 172.21.15.80:0/3053402969' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-17T23:18:50.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:49 smithi005 bash[38535]: audit 2024-02-17T23:18:49.487135+0000 mon.a (mon.0) 532 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-02-17T23:18:50.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:49 smithi005 bash[38535]: audit 2024-02-17T23:18:49.490686+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-02-17T23:18:50.477 DEBUG:teuthology.orchestra.run.smithi080:> set -ex 2024-02-17T23:18:50.477 DEBUG:teuthology.orchestra.run.smithi080:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-02-17T23:18:50.477 DEBUG:teuthology.orchestra.run.smithi080:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-02-17T23:18:50.520 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-17T23:18:51.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:51 smithi080 bash[35203]: cluster 2024-02-17T23:18:49.974505+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:52.073 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:51 smithi005 bash[35193]: cluster 2024-02-17T23:18:49.974505+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:52.073 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:51 smithi005 bash[38535]: cluster 2024-02-17T23:18:49.974505+0000 mgr.y (mgr.14140) 173 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:52.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:52 smithi080 podman[44615]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus.a" found: no such container 2024-02-17T23:18:52.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:52 smithi080 systemd[1]: Started Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:18:52.760 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:18:52.760 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"fsid":"1ffcdf7e-cdea-11ee-95ba-87774f69a715","created":"2024-02-17T23:13:43.219702+0000","modified":"2024-02-17T23:18:29.715258+0000","last_up_change":"2024-02-17T23:18:28.706464+0000","last_in_change":"2024-02-17T23:18:28.706464+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-17T23:13:54.612383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"7c17641c-5dc3-4499-9f48-d83bc5083c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6803","nonce":2278288718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6805","nonce":2278288718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6809","nonce":2278288718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6807","nonce":2278288718}]},"public_addr":"172.21.15.5:6803/2278288718","cluster_addr":"172.21.15.5:6805/2278288718","heartbeat_back_addr":"172.21.15.5:6809/2278288718","heartbeat_front_addr":"172.21.15.5:6807/2278288718","state":["exists","up"]},{"osd":1,"uuid":"53145211-95db-47c4-946c-d258f1bd2277","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6811","nonce":2800558693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6813","nonce":2800558693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6817","nonce":2800558693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6815","nonce":2800558693}]},"public_addr":"172.21.15.5:6811/2800558693","cluster_addr":"172.21.15.5:6813/2800558693","heartbeat_back_addr":"172.21.15.5:6817/2800558693","heartbeat_front_addr":"172.21.15.5:6815/2800558693","state":["exists","up"]},{"osd":2,"uuid":"00b874d3-a65b-4855-bf32-106d604add53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6819","nonce":2632773501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6821","nonce":2632773501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6825","nonce":2632773501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6823","nonce":2632773501}]},"public_addr":"172.21.15.5:6819/2632773501","cluster_addr":"172.21.15.5:6821/2632773501","heartbeat_back_addr":"172.21.15.5:6825/2632773501","heartbeat_front_addr":"172.21.15.5:6823/2632773501","state":["exists","up"]},{"osd":3,"uuid":"090543ef-5784-4b6c-a6b8-456f4c98440c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6827","nonce":192017774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6829","nonce":192017774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6833","nonce":192017774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6831","nonce":192017774}]},"public_addr":"172.21.15.5:6827/192017774","cluster_addr":"172.21.15.5:6829/192017774","heartbeat_back_addr":"172.21.15.5:6833/192017774","heartbeat_front_addr":"172.21.15.5:6831/192017774","state":["exists","up"]},{"osd":4,"uuid":"1155a36f-e150-4d31-aac3-2ac9081cd6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6801","nonce":3612340780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6803","nonce":3612340780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6807","nonce":3612340780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6805","nonce":3612340780}]},"public_addr":"172.21.15.80:6801/3612340780","cluster_addr":"172.21.15.80:6803/3612340780","heartbeat_back_addr":"172.21.15.80:6807/3612340780","heartbeat_front_addr":"172.21.15.80:6805/3612340780","state":["exists","up"]},{"osd":5,"uuid":"80950c10-2920-43c8-ad6c-f4b013db0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":36,"last_clean_end":38,"up_from":41,"up_thru":41,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6809","nonce":3311768384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6811","nonce":3311768384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6815","nonce":3311768384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6813","nonce":3311768384}]},"public_addr":"172.21.15.80:6809/3311768384","cluster_addr":"172.21.15.80:6811/3311768384","heartbeat_back_addr":"172.21.15.80:6815/3311768384","heartbeat_front_addr":"172.21.15.80:6813/3311768384","state":["exists","up"]},{"osd":6,"uuid":"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6817","nonce":2982577173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6819","nonce":2982577173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6823","nonce":2982577173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6821","nonce":2982577173}]},"public_addr":"172.21.15.80:6817/2982577173","cluster_addr":"172.21.15.80:6819/2982577173","heartbeat_back_addr":"172.21.15.80:6823/2982577173","heartbeat_front_addr":"172.21.15.80:6821/2982577173","state":["exists","up"]},{"osd":7,"uuid":"14e72964-304a-427b-bfcf-cd0f7188c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6825","nonce":3532387544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6827","nonce":3532387544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6831","nonce":3532387544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6829","nonce":3532387544}]},"public_addr":"172.21.15.80:6825/3532387544","cluster_addr":"172.21.15.80:6827/3532387544","heartbeat_back_addr":"172.21.15.80:6831/3532387544","heartbeat_front_addr":"172.21.15.80:6829/3532387544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:16:05.817027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:16:26.728508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:16:46.426810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:17:08.150009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:17:25.635884+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:17:45.490696+0000","dead_epoch":39},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:18:08.831538+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:18:26.787492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.5:0/1056227574":"2024-02-18T23:14:23.593148+0000","172.21.15.5:0/1627243195":"2024-02-18T23:14:23.593148+0000","172.21.15.5:0/1962775691":"2024-02-18T23:14:23.593148+0000","172.21.15.5:6801/1225164636":"2024-02-18T23:14:23.593148+0000","172.21.15.5:6800/1225164636":"2024-02-18T23:14:23.593148+0000","172.21.15.5:0/261352023":"2024-02-18T23:14:01.424087+0000","172.21.15.5:0/436792252":"2024-02-18T23:14:01.424087+0000","172.21.15.5:6801/4012152535":"2024-02-18T23:14:01.424087+0000","172.21.15.5:0/3034159752":"2024-02-18T23:14:01.424087+0000","172.21.15.5:6800/4012152535":"2024-02-18T23:14:01.424087+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-17T23:18:53.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:52 smithi005 bash[38535]: audit 2024-02-17T23:18:52.323632+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:53.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:52 smithi005 bash[38535]: audit 2024-02-17T23:18:52.327425+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:53.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:52 smithi005 bash[38535]: audit 2024-02-17T23:18:52.328280+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:53.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:52 smithi005 bash[38535]: audit 2024-02-17T23:18:52.758008+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.5:0/3944979246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-17T23:18:53.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:52 smithi005 bash[35193]: audit 2024-02-17T23:18:52.323632+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:53.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:52 smithi005 bash[35193]: audit 2024-02-17T23:18:52.327425+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:53.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:52 smithi005 bash[35193]: audit 2024-02-17T23:18:52.328280+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:53.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:52 smithi005 bash[35193]: audit 2024-02-17T23:18:52.758008+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.5:0/3944979246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-17T23:18:53.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:52 smithi080 bash[35203]: audit 2024-02-17T23:18:52.323632+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:53.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:52 smithi080 bash[35203]: audit 2024-02-17T23:18:52.327425+0000 mon.a (mon.0) 535 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590863\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590941\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.590976\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591006\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591047\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:25.591087\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:53.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:52 smithi080 bash[35203]: audit 2024-02-17T23:18:52.328280+0000 mon.a (mon.0) 536 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:18:53.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:52 smithi080 bash[35203]: audit 2024-02-17T23:18:52.758008+0000 mon.a (mon.0) 537 : audit [DBG] from='client.? 172.21.15.5:0/3944979246' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-17T23:18:53.634 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-02-17T23:13:54.612383+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-02-17T23:18:53.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-02-17T23:18:53.639 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.049Z caller=main.go:544 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-17T23:18:53.639 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.049Z caller=main.go:588 level=info msg="Starting Prometheus Server" mode=server version="(version=2.49.1, branch=HEAD, revision=43e14844a33b65e2a396e3944272af8b3a494071)" 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.049Z caller=main.go:593 level=info build_context="(go=go1.21.6, platform=linux/amd64, user=root@6d5f4c649d25, date=20240115-16:58:43, tags=netgo,builtinassets,stringlabels)" 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.049Z caller=main.go:594 level=info host_details="(Linux 4.18.0-539.el8.x86_64 #1 SMP Mon Feb 5 18:34:56 UTC 2024 x86_64 smithi080 (none))" 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.049Z caller=main.go:595 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.049Z caller=main.go:596 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.050Z caller=web.go:565 level=info component=web msg="Start listening for connections" address=:9095 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.051Z caller=main.go:1039 level=info msg="Starting TSDB ..." 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.052Z caller=tls_config.go:274 level=info component=web msg="Listening on" address=[::]:9095 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.052Z caller=tls_config.go:277 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.054Z caller=head.go:606 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.054Z caller=head.go:687 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.118µs 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.054Z caller=head.go:695 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.054Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-02-17T23:18:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.054Z caller=head.go:803 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=50.136µs wal_replay_duration=187.649µs wbl_replay_duration=134ns total_replay_duration=267.11µs 2024-02-17T23:18:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.055Z caller=main.go:1060 level=info fs_type=XFS_SUPER_MAGIC 2024-02-17T23:18:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.055Z caller=main.go:1063 level=info msg="TSDB started" 2024-02-17T23:18:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.055Z caller=main.go:1245 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-17T23:18:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.056Z caller=main.go:1282 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=569.641µs db_storage=736ns remote_storage=926ns web_handler=391ns query_engine=566ns scrape=345.198µs scrape_sd=17.161µs notify=961ns notify_sd=1.839µs rules=46.789µs tracing=6.322µs 2024-02-17T23:18:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.056Z caller=main.go:1024 level=info msg="Server is ready to receive web requests." 2024-02-17T23:18:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[44633]: ts=2024-02-17T23:18:53.056Z caller=manager.go:146 level=info component="rule manager" msg="Starting rule manager..." 2024-02-17T23:18:53.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:53 smithi005 bash[35193]: cluster 2024-02-17T23:18:51.974817+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:53.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:53 smithi005 bash[38535]: cluster 2024-02-17T23:18:51.974817+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:54.116 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:53 smithi080 bash[35203]: cluster 2024-02-17T23:18:51.974817+0000 mgr.y (mgr.14140) 174 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:55.122 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:18:55 smithi080 systemd[1]: Starting Ceph node-exporter.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:18:55.122 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:54 smithi080 bash[35203]: audit 2024-02-17T23:18:54.694381+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_daemon_update\": \"2024-02-17T23:18:54.693693\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:55.122 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:54 smithi080 bash[35203]: audit 2024-02-17T23:18:54.697598+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_daemon_update\": \"2024-02-17T23:18:54.693693\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:55.123 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:54 smithi080 bash[35203]: audit 2024-02-17T23:18:54.698991+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-17T23:18:55.123 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:54 smithi080 bash[35203]: audit 2024-02-17T23:18:54.699647+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:54 smithi005 bash[35193]: audit 2024-02-17T23:18:54.694381+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_daemon_update\": \"2024-02-17T23:18:54.693693\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:55.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:54 smithi005 bash[38535]: audit 2024-02-17T23:18:54.694381+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_daemon_update\": \"2024-02-17T23:18:54.693693\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:55.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:54 smithi005 bash[35193]: audit 2024-02-17T23:18:54.697598+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_daemon_update\": \"2024-02-17T23:18:54.693693\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:55.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:54 smithi005 bash[35193]: audit 2024-02-17T23:18:54.698991+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-17T23:18:55.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:54 smithi005 bash[35193]: audit 2024-02-17T23:18:54.699647+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:55.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:54 smithi005 bash[38535]: audit 2024-02-17T23:18:54.697598+0000 mon.a (mon.0) 539 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}}, \"last_daemon_update\": \"2024-02-17T23:18:54.693693\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:55.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:54 smithi005 bash[38535]: audit 2024-02-17T23:18:54.698991+0000 mon.a (mon.0) 540 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-17T23:18:55.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:54 smithi005 bash[38535]: audit 2024-02-17T23:18:54.699647+0000 mon.a (mon.0) 541 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:55.390 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:18:55 smithi080 podman[45035]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter.b" found: no such container 2024-02-17T23:18:55.390 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:18:55 smithi080 systemd[1]: Started Ceph node-exporter.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:18:55.390 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:18:55 smithi080 bash[45051]: Resolving "prom/node-exporter" using unqualified-search registries (/etc/containers/registries.conf) 2024-02-17T23:18:55.390 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:18:55 smithi080 bash[45051]: Trying to pull docker.io/prom/node-exporter:latest... 2024-02-17T23:18:56.072 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:18:55 smithi005 podman[46937]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter.a" found: no such container 2024-02-17T23:18:56.072 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:18:55 smithi005 systemd[1]: Started Ceph node-exporter.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:18:56.072 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[35193]: cluster 2024-02-17T23:18:53.975152+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:56.072 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[35193]: cephadm 2024-02-17T23:18:54.700191+0000 mgr.y (mgr.14140) 176 : cephadm [INF] Deploying daemon node-exporter.b on smithi080 2024-02-17T23:18:56.072 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[35193]: audit 2024-02-17T23:18:55.183102+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:56.073 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[38535]: cluster 2024-02-17T23:18:53.975152+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:56.073 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[38535]: cephadm 2024-02-17T23:18:54.700191+0000 mgr.y (mgr.14140) 176 : cephadm [INF] Deploying daemon node-exporter.b on smithi080 2024-02-17T23:18:56.073 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[35193]: audit 2024-02-17T23:18:55.186341+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:56.073 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[35193]: audit 2024-02-17T23:18:55.187070+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-17T23:18:56.073 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[35193]: audit 2024-02-17T23:18:55.187870+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:56.074 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[38535]: audit 2024-02-17T23:18:55.183102+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:56.074 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[38535]: audit 2024-02-17T23:18:55.186341+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:56.074 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[38535]: audit 2024-02-17T23:18:55.187070+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-17T23:18:56.074 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[38535]: audit 2024-02-17T23:18:55.187870+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:56.074 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[35193]: audit 2024-02-17T23:18:55.749457+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:18:56.075 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[35193]: audit 2024-02-17T23:18:55.752498+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:18:56.075 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[38535]: audit 2024-02-17T23:18:55.749457+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:18:56.075 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:55 smithi005 bash[38535]: audit 2024-02-17T23:18:55.752498+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:18:56.124 INFO:teuthology.orchestra.run.smithi005.stdout:pg_num: 1 2024-02-17T23:18:56.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:55 smithi080 bash[35203]: cluster 2024-02-17T23:18:53.975152+0000 mgr.y (mgr.14140) 175 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:56.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:55 smithi080 bash[35203]: cephadm 2024-02-17T23:18:54.700191+0000 mgr.y (mgr.14140) 176 : cephadm [INF] Deploying daemon node-exporter.b on smithi080 2024-02-17T23:18:56.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:55 smithi080 bash[35203]: audit 2024-02-17T23:18:55.183102+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:18:56.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:55 smithi080 bash[35203]: audit 2024-02-17T23:18:55.186341+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:18:56.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:55 smithi080 bash[35203]: audit 2024-02-17T23:18:55.187070+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon"}]: dispatch 2024-02-17T23:18:56.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:55 smithi080 bash[35203]: audit 2024-02-17T23:18:55.187870+0000 mon.a (mon.0) 545 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:18:56.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:55 smithi080 bash[35203]: audit 2024-02-17T23:18:55.749457+0000 mon.a (mon.0) 546 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:18:56.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:55 smithi080 bash[35203]: audit 2024-02-17T23:18:55.752498+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:18:56.376 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:18:56 smithi005 bash[46969]: Resolving "prom/node-exporter" using unqualified-search registries (/etc/containers/registries.conf) 2024-02-17T23:18:56.376 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:18:56 smithi005 bash[46969]: Trying to pull docker.io/prom/node-exporter:latest... 2024-02-17T23:18:56.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:56 smithi005 bash[35193]: cephadm 2024-02-17T23:18:55.188493+0000 mgr.y (mgr.14140) 177 : cephadm [INF] Deploying daemon node-exporter.a on smithi005 2024-02-17T23:18:56.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:56 smithi005 bash[35193]: cephadm 2024-02-17T23:18:55.754744+0000 mgr.y (mgr.14140) 178 : cephadm [INF] Deploying daemon alertmanager.a on smithi005 2024-02-17T23:18:56.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:56 smithi005 bash[35193]: audit 2024-02-17T23:18:56.122517+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.5:0/2397274189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-17T23:18:56.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:56 smithi005 bash[38535]: cephadm 2024-02-17T23:18:55.188493+0000 mgr.y (mgr.14140) 177 : cephadm [INF] Deploying daemon node-exporter.a on smithi005 2024-02-17T23:18:56.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:56 smithi005 bash[38535]: cephadm 2024-02-17T23:18:55.754744+0000 mgr.y (mgr.14140) 178 : cephadm [INF] Deploying daemon alertmanager.a on smithi005 2024-02-17T23:18:56.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:56 smithi005 bash[38535]: audit 2024-02-17T23:18:56.122517+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.5:0/2397274189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-17T23:18:56.940 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-02-17T23:18:56.940 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-02-17T23:18:56.940 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph mgr dump --format=json 2024-02-17T23:18:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:56 smithi080 bash[35203]: cephadm 2024-02-17T23:18:55.188493+0000 mgr.y (mgr.14140) 177 : cephadm [INF] Deploying daemon node-exporter.a on smithi005 2024-02-17T23:18:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:56 smithi080 bash[35203]: cephadm 2024-02-17T23:18:55.754744+0000 mgr.y (mgr.14140) 178 : cephadm [INF] Deploying daemon alertmanager.a on smithi005 2024-02-17T23:18:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:56 smithi080 bash[35203]: audit 2024-02-17T23:18:56.122517+0000 mon.c (mon.1) 15 : audit [DBG] from='client.? 172.21.15.5:0/2397274189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-02-17T23:18:58.094 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:57 smithi005 bash[35193]: cluster 2024-02-17T23:18:55.975464+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:58.094 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:57 smithi005 bash[38535]: cluster 2024-02-17T23:18:55.975464+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:57 smithi080 bash[35203]: cluster 2024-02-17T23:18:55.975464+0000 mgr.y (mgr.14140) 179 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:18:59.373 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:19:00.091 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:59 smithi005 bash[35193]: cluster 2024-02-17T23:18:57.975944+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:00.091 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:18:59 smithi005 bash[35193]: audit 2024-02-17T23:18:59.368678+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.5:0/3005754863' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-17T23:19:00.092 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:59 smithi005 bash[38535]: cluster 2024-02-17T23:18:57.975944+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:00.092 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:18:59 smithi005 bash[38535]: audit 2024-02-17T23:18:59.368678+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.5:0/3005754863' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-17T23:19:00.104 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":14,"active_gid":14140,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6800","nonce":742581822},{"type":"v1","addr":"172.21.15.5:6801","nonce":742581822}]},"active_addr":"172.21.15.5:6801/742581822","active_change":"2024-02-17T23:14:23.593445+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":34109,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi005.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","osd_support","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":5,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":3411966863}]},{"addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":521329638}]},{"addrvec":[{"type":"v2","addr":"172.21.15.5:0","nonce":659891763}]}]}} 2024-02-17T23:19:00.107 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-02-17T23:19:00.107 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-02-17T23:19:00.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-17T23:19:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:59 smithi080 bash[35203]: cluster 2024-02-17T23:18:57.975944+0000 mgr.y (mgr.14140) 180 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:18:59 smithi080 bash[35203]: audit 2024-02-17T23:18:59.368678+0000 mon.c (mon.1) 16 : audit [DBG] from='client.? 172.21.15.5:0/3005754863' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-02-17T23:19:01.939 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:01 smithi005 bash[35193]: cluster 2024-02-17T23:18:59.976319+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:01.939 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:01 smithi005 bash[38535]: cluster 2024-02-17T23:18:59.976319+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:02.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:01 smithi080 bash[35203]: cluster 2024-02-17T23:18:59.976319+0000 mgr.y (mgr.14140) 181 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:02.140 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:01 smithi080 bash[45051]: Getting image source signatures 2024-02-17T23:19:02.140 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:01 smithi080 bash[45051]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-02-17T23:19:02.140 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:01 smithi080 bash[45051]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-02-17T23:19:02.140 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:01 smithi080 bash[45051]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-02-17T23:19:02.338 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:19:02.338 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"fsid":"1ffcdf7e-cdea-11ee-95ba-87774f69a715","created":"2024-02-17T23:13:43.219702+0000","modified":"2024-02-17T23:18:29.715258+0000","last_up_change":"2024-02-17T23:18:28.706464+0000","last_in_change":"2024-02-17T23:18:28.706464+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-17T23:13:54.612383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"7c17641c-5dc3-4499-9f48-d83bc5083c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6803","nonce":2278288718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6805","nonce":2278288718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6809","nonce":2278288718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6807","nonce":2278288718}]},"public_addr":"172.21.15.5:6803/2278288718","cluster_addr":"172.21.15.5:6805/2278288718","heartbeat_back_addr":"172.21.15.5:6809/2278288718","heartbeat_front_addr":"172.21.15.5:6807/2278288718","state":["exists","up"]},{"osd":1,"uuid":"53145211-95db-47c4-946c-d258f1bd2277","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6811","nonce":2800558693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6813","nonce":2800558693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6817","nonce":2800558693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6815","nonce":2800558693}]},"public_addr":"172.21.15.5:6811/2800558693","cluster_addr":"172.21.15.5:6813/2800558693","heartbeat_back_addr":"172.21.15.5:6817/2800558693","heartbeat_front_addr":"172.21.15.5:6815/2800558693","state":["exists","up"]},{"osd":2,"uuid":"00b874d3-a65b-4855-bf32-106d604add53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6819","nonce":2632773501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6821","nonce":2632773501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6825","nonce":2632773501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6823","nonce":2632773501}]},"public_addr":"172.21.15.5:6819/2632773501","cluster_addr":"172.21.15.5:6821/2632773501","heartbeat_back_addr":"172.21.15.5:6825/2632773501","heartbeat_front_addr":"172.21.15.5:6823/2632773501","state":["exists","up"]},{"osd":3,"uuid":"090543ef-5784-4b6c-a6b8-456f4c98440c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6827","nonce":192017774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6829","nonce":192017774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6833","nonce":192017774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6831","nonce":192017774}]},"public_addr":"172.21.15.5:6827/192017774","cluster_addr":"172.21.15.5:6829/192017774","heartbeat_back_addr":"172.21.15.5:6833/192017774","heartbeat_front_addr":"172.21.15.5:6831/192017774","state":["exists","up"]},{"osd":4,"uuid":"1155a36f-e150-4d31-aac3-2ac9081cd6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6801","nonce":3612340780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6803","nonce":3612340780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6807","nonce":3612340780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6805","nonce":3612340780}]},"public_addr":"172.21.15.80:6801/3612340780","cluster_addr":"172.21.15.80:6803/3612340780","heartbeat_back_addr":"172.21.15.80:6807/3612340780","heartbeat_front_addr":"172.21.15.80:6805/3612340780","state":["exists","up"]},{"osd":5,"uuid":"80950c10-2920-43c8-ad6c-f4b013db0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":36,"last_clean_end":38,"up_from":41,"up_thru":41,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6809","nonce":3311768384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6811","nonce":3311768384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6815","nonce":3311768384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6813","nonce":3311768384}]},"public_addr":"172.21.15.80:6809/3311768384","cluster_addr":"172.21.15.80:6811/3311768384","heartbeat_back_addr":"172.21.15.80:6815/3311768384","heartbeat_front_addr":"172.21.15.80:6813/3311768384","state":["exists","up"]},{"osd":6,"uuid":"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6817","nonce":2982577173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6819","nonce":2982577173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6823","nonce":2982577173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6821","nonce":2982577173}]},"public_addr":"172.21.15.80:6817/2982577173","cluster_addr":"172.21.15.80:6819/2982577173","heartbeat_back_addr":"172.21.15.80:6823/2982577173","heartbeat_front_addr":"172.21.15.80:6821/2982577173","state":["exists","up"]},{"osd":7,"uuid":"14e72964-304a-427b-bfcf-cd0f7188c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6825","nonce":3532387544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6827","nonce":3532387544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6831","nonce":3532387544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6829","nonce":3532387544}]},"public_addr":"172.21.15.80:6825/3532387544","cluster_addr":"172.21.15.80:6827/3532387544","heartbeat_back_addr":"172.21.15.80:6831/3532387544","heartbeat_front_addr":"172.21.15.80:6829/3532387544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:16:05.817027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:16:26.728508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:16:46.426810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:17:08.150009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:17:25.635884+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:17:45.490696+0000","dead_epoch":39},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:18:08.831538+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:18:26.787492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.5:0/1056227574":"2024-02-18T23:14:23.593148+0000","172.21.15.5:0/1627243195":"2024-02-18T23:14:23.593148+0000","172.21.15.5:0/1962775691":"2024-02-18T23:14:23.593148+0000","172.21.15.5:6801/1225164636":"2024-02-18T23:14:23.593148+0000","172.21.15.5:6800/1225164636":"2024-02-18T23:14:23.593148+0000","172.21.15.5:0/261352023":"2024-02-18T23:14:01.424087+0000","172.21.15.5:0/436792252":"2024-02-18T23:14:01.424087+0000","172.21.15.5:6801/4012152535":"2024-02-18T23:14:01.424087+0000","172.21.15.5:0/3034159752":"2024-02-18T23:14:01.424087+0000","172.21.15.5:6800/4012152535":"2024-02-18T23:14:01.424087+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-17T23:19:02.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:02 smithi005 bash[46969]: Getting image source signatures 2024-02-17T23:19:02.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:02 smithi005 bash[46969]: Copying blob sha256:324153f2810a9927fcce320af9e4e291e0b6e805cbdd1f338386c756b9defa24 2024-02-17T23:19:02.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:02 smithi005 bash[46969]: Copying blob sha256:2abcce694348cd2c949c0e98a7400ebdfd8341021bcf6b541bc72033ce982510 2024-02-17T23:19:02.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:02 smithi005 bash[46969]: Copying blob sha256:455fd88e5221bc1e278ef2d059cd70e4df99a24e5af050ede621534276f6cf9a 2024-02-17T23:19:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:02 smithi005 bash[35193]: audit 2024-02-17T23:19:02.336512+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.15.5:0/960422310' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-17T23:19:03.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:02 smithi005 bash[38535]: audit 2024-02-17T23:19:02.336512+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.15.5:0/960422310' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-17T23:19:03.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:02 smithi080 bash[35203]: audit 2024-02-17T23:19:02.336512+0000 mon.a (mon.0) 548 : audit [DBG] from='client.? 172.21.15.5:0/960422310' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-17T23:19:03.310 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-02-17T23:19:03.311 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd dump --format=json 2024-02-17T23:19:03.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:03 smithi080 bash[35203]: cluster 2024-02-17T23:19:01.976750+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:03.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:03 smithi080 bash[45051]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-02-17T23:19:03.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:03 smithi080 bash[45051]: Writing manifest to image destination 2024-02-17T23:19:04.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:03 smithi005 bash[38535]: cluster 2024-02-17T23:19:01.976750+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:03 smithi005 bash[35193]: cluster 2024-02-17T23:19:01.976750+0000 mgr.y (mgr.14140) 182 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:04.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.389Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-02-17T23:19:04.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.389Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-02-17T23:19:04.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.389Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-02-17T23:19:04.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.389Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-17T23:19:04.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.389Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-02-17T23:19:04.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-02-17T23:19:04.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-02-17T23:19:04.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=arp 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=bcache 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=bonding 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=btrfs 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=conntrack 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=cpu 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=diskstats 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=dmi 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=edac 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=entropy 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=filefd 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=filesystem 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=hwmon 2024-02-17T23:19:04.891 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=infiniband 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=ipvs 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=loadavg 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=mdadm 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=meminfo 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=netclass 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=netdev 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=netstat 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=nfs 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=nfsd 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=nvme 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=os 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=pressure 2024-02-17T23:19:04.892 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=rapl 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=schedstat 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=selinux 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=sockstat 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=softnet 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=stat 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=tapestats 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=textfile 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=time 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=uname 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=vmstat 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=xfs 2024-02-17T23:19:04.893 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.390Z caller=node_exporter.go:117 level=info collector=zfs 2024-02-17T23:19:04.894 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.391Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-02-17T23:19:04.894 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:19:04 smithi080 bash[45051]: ts=2024-02-17T23:19:04.391Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-02-17T23:19:06.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:05 smithi005 bash[35193]: cluster 2024-02-17T23:19:03.977288+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:06.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:05 smithi005 bash[38535]: cluster 2024-02-17T23:19:03.977288+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:06.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:05 smithi080 bash[35203]: cluster 2024-02-17T23:19:03.977288+0000 mgr.y (mgr.14140) 183 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:06.305 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:19:06.305 INFO:teuthology.orchestra.run.smithi005.stdout:{"epoch":51,"fsid":"1ffcdf7e-cdea-11ee-95ba-87774f69a715","created":"2024-02-17T23:13:43.219702+0000","modified":"2024-02-17T23:18:29.715258+0000","last_up_change":"2024-02-17T23:18:28.706464+0000","last_in_change":"2024-02-17T23:18:28.706464+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-02-17T23:13:54.612383+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"7c17641c-5dc3-4499-9f48-d83bc5083c0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6802","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6803","nonce":2278288718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6804","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6805","nonce":2278288718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6808","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6809","nonce":2278288718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6806","nonce":2278288718},{"type":"v1","addr":"172.21.15.5:6807","nonce":2278288718}]},"public_addr":"172.21.15.5:6803/2278288718","cluster_addr":"172.21.15.5:6805/2278288718","heartbeat_back_addr":"172.21.15.5:6809/2278288718","heartbeat_front_addr":"172.21.15.5:6807/2278288718","state":["exists","up"]},{"osd":1,"uuid":"53145211-95db-47c4-946c-d258f1bd2277","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6810","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6811","nonce":2800558693}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6812","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6813","nonce":2800558693}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6816","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6817","nonce":2800558693}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6814","nonce":2800558693},{"type":"v1","addr":"172.21.15.5:6815","nonce":2800558693}]},"public_addr":"172.21.15.5:6811/2800558693","cluster_addr":"172.21.15.5:6813/2800558693","heartbeat_back_addr":"172.21.15.5:6817/2800558693","heartbeat_front_addr":"172.21.15.5:6815/2800558693","state":["exists","up"]},{"osd":2,"uuid":"00b874d3-a65b-4855-bf32-106d604add53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6818","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6819","nonce":2632773501}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6820","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6821","nonce":2632773501}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6824","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6825","nonce":2632773501}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6822","nonce":2632773501},{"type":"v1","addr":"172.21.15.5:6823","nonce":2632773501}]},"public_addr":"172.21.15.5:6819/2632773501","cluster_addr":"172.21.15.5:6821/2632773501","heartbeat_back_addr":"172.21.15.5:6825/2632773501","heartbeat_front_addr":"172.21.15.5:6823/2632773501","state":["exists","up"]},{"osd":3,"uuid":"090543ef-5784-4b6c-a6b8-456f4c98440c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6826","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6827","nonce":192017774}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6828","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6829","nonce":192017774}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6832","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6833","nonce":192017774}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.5:6830","nonce":192017774},{"type":"v1","addr":"172.21.15.5:6831","nonce":192017774}]},"public_addr":"172.21.15.5:6827/192017774","cluster_addr":"172.21.15.5:6829/192017774","heartbeat_back_addr":"172.21.15.5:6833/192017774","heartbeat_front_addr":"172.21.15.5:6831/192017774","state":["exists","up"]},{"osd":4,"uuid":"1155a36f-e150-4d31-aac3-2ac9081cd6aa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6800","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6801","nonce":3612340780}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6802","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6803","nonce":3612340780}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6806","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6807","nonce":3612340780}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6804","nonce":3612340780},{"type":"v1","addr":"172.21.15.80:6805","nonce":3612340780}]},"public_addr":"172.21.15.80:6801/3612340780","cluster_addr":"172.21.15.80:6803/3612340780","heartbeat_back_addr":"172.21.15.80:6807/3612340780","heartbeat_front_addr":"172.21.15.80:6805/3612340780","state":["exists","up"]},{"osd":5,"uuid":"80950c10-2920-43c8-ad6c-f4b013db0c99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":36,"last_clean_end":38,"up_from":41,"up_thru":41,"down_at":39,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6808","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6809","nonce":3311768384}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6810","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6811","nonce":3311768384}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6814","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6815","nonce":3311768384}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6812","nonce":3311768384},{"type":"v1","addr":"172.21.15.80:6813","nonce":3311768384}]},"public_addr":"172.21.15.80:6809/3311768384","cluster_addr":"172.21.15.80:6811/3311768384","heartbeat_back_addr":"172.21.15.80:6815/3311768384","heartbeat_front_addr":"172.21.15.80:6813/3311768384","state":["exists","up"]},{"osd":6,"uuid":"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6816","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6817","nonce":2982577173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6818","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6819","nonce":2982577173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6822","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6823","nonce":2982577173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6820","nonce":2982577173},{"type":"v1","addr":"172.21.15.80:6821","nonce":2982577173}]},"public_addr":"172.21.15.80:6817/2982577173","cluster_addr":"172.21.15.80:6819/2982577173","heartbeat_back_addr":"172.21.15.80:6823/2982577173","heartbeat_front_addr":"172.21.15.80:6821/2982577173","state":["exists","up"]},{"osd":7,"uuid":"14e72964-304a-427b-bfcf-cd0f7188c969","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":50,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6824","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6825","nonce":3532387544}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6826","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6827","nonce":3532387544}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6830","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6831","nonce":3532387544}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.80:6828","nonce":3532387544},{"type":"v1","addr":"172.21.15.80:6829","nonce":3532387544}]},"public_addr":"172.21.15.80:6825/3532387544","cluster_addr":"172.21.15.80:6827/3532387544","heartbeat_back_addr":"172.21.15.80:6831/3532387544","heartbeat_front_addr":"172.21.15.80:6829/3532387544","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:16:05.817027+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:16:26.728508+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:16:46.426810+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:17:08.150009+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:17:25.635884+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:17:45.490696+0000","dead_epoch":39},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:18:08.831538+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2024-02-17T23:18:26.787492+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{"172.21.15.5:0/1056227574":"2024-02-18T23:14:23.593148+0000","172.21.15.5:0/1627243195":"2024-02-18T23:14:23.593148+0000","172.21.15.5:0/1962775691":"2024-02-18T23:14:23.593148+0000","172.21.15.5:6801/1225164636":"2024-02-18T23:14:23.593148+0000","172.21.15.5:6800/1225164636":"2024-02-18T23:14:23.593148+0000","172.21.15.5:0/261352023":"2024-02-18T23:14:01.424087+0000","172.21.15.5:0/436792252":"2024-02-18T23:14:01.424087+0000","172.21.15.5:6801/4012152535":"2024-02-18T23:14:01.424087+0000","172.21.15.5:0/3034159752":"2024-02-18T23:14:01.424087+0000","172.21.15.5:6800/4012152535":"2024-02-18T23:14:01.424087+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-02-17T23:19:06.973 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:06 smithi005 bash[46969]: Copying config sha256:72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e 2024-02-17T23:19:06.973 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:06 smithi005 bash[35193]: audit 2024-02-17T23:19:06.302501+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.5:0/481175449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-17T23:19:06.974 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:06 smithi005 bash[38535]: audit 2024-02-17T23:19:06.302501+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.5:0/481175449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-17T23:19:07.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:06 smithi080 bash[35203]: audit 2024-02-17T23:19:06.302501+0000 mon.c (mon.1) 17 : audit [DBG] from='client.? 172.21.15.5:0/481175449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-02-17T23:19:07.376 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:07 smithi005 bash[46969]: Writing manifest to image destination 2024-02-17T23:19:07.875 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:07 smithi005 bash[35193]: cluster 2024-02-17T23:19:05.977640+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:07 smithi005 bash[38535]: cluster 2024-02-17T23:19:05.977640+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:08.054 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-02-17T23:19:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:07 smithi080 bash[35203]: cluster 2024-02-17T23:19:05.977640+0000 mgr.y (mgr.14140) 184 : cluster [DBG] pgmap v181: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:09.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:09 smithi005 bash[35193]: cluster 2024-02-17T23:19:07.978171+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:09.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:09 smithi005 bash[38535]: cluster 2024-02-17T23:19:07.978171+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:10.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:09 smithi080 bash[35203]: cluster 2024-02-17T23:19:07.978171+0000 mgr.y (mgr.14140) 185 : cluster [DBG] pgmap v182: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:10.376 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.721Z caller=node_exporter.go:192 level=info msg="Starting node_exporter" version="(version=1.7.0, branch=HEAD, revision=7333465abf9efba81876303bb57e6fadb946041b)" 2024-02-17T23:19:10.376 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.721Z caller=node_exporter.go:193 level=info msg="Build context" build_context="(go=go1.21.4, platform=linux/amd64, user=root@35918982f6d8, date=20231112-23:53:35, tags=netgo osusergo static_build)" 2024-02-17T23:19:10.376 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.721Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-02-17T23:19:10.376 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.721Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-17T23:19:10.376 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-02-17T23:19:10.376 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=diskstats_linux.go:265 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-02-17T23:19:10.376 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=arp 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=bcache 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=bonding 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=btrfs 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=conntrack 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=cpu 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=diskstats 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=dmi 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=edac 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=entropy 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=filefd 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=filesystem 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=hwmon 2024-02-17T23:19:10.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.722Z caller=node_exporter.go:117 level=info collector=infiniband 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=ipvs 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=loadavg 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=mdadm 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=meminfo 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=netclass 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=netdev 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=netstat 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=nfs 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=nfsd 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=nvme 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=os 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=pressure 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=rapl 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=schedstat 2024-02-17T23:19:10.378 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=selinux 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=sockstat 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=softnet 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=stat 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=tapestats 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=textfile 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=time 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=uname 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=vmstat 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=xfs 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=node_exporter.go:117 level=info collector=zfs 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9100 2024-02-17T23:19:10.379 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:19:10 smithi005 bash[46969]: ts=2024-02-17T23:19:08.723Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-02-17T23:19:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:11 smithi005 bash[35193]: cluster 2024-02-17T23:19:09.978511+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:12.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:11 smithi005 bash[38535]: cluster 2024-02-17T23:19:09.978511+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:12.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:11 smithi080 bash[35203]: cluster 2024-02-17T23:19:09.978511+0000 mgr.y (mgr.14140) 186 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:13.032 INFO:teuthology.orchestra.run.smithi005.stdout:42949672999 2024-02-17T23:19:13.032 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-02-17T23:19:13.833 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:13 smithi005 bash[35193]: cluster 2024-02-17T23:19:11.979054+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:13.833 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:13 smithi005 bash[38535]: cluster 2024-02-17T23:19:11.979054+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:14.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:13 smithi080 bash[35203]: cluster 2024-02-17T23:19:11.979054+0000 mgr.y (mgr.14140) 187 : cluster [DBG] pgmap v184: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:15.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:15 smithi005 bash[35193]: cluster 2024-02-17T23:19:13.979378+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:15.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:15 smithi005 bash[38535]: cluster 2024-02-17T23:19:13.979378+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:16.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:15 smithi080 bash[35203]: cluster 2024-02-17T23:19:13.979378+0000 mgr.y (mgr.14140) 188 : cluster [DBG] pgmap v185: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:16.188 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:15 smithi005 systemd[1]: Starting Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:19:16.717 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:16 smithi005 podman[48107]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager.a" found: no such container 2024-02-17T23:19:16.717 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:16 smithi005 systemd[1]: Started Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:19:17.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[38535]: audit 2024-02-17T23:19:16.496285+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:19:17.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[38535]: audit 2024-02-17T23:19:16.499160+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:19:17.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[38535]: audit 2024-02-17T23:19:16.685936+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCC8/1XVHFPu4iRNUwMZcIIMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMjE3MjMxOTE2WhcN\nMzQwMjE0MjMxOTE2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAuAuVyMiJWznR88E7MSJ4\neh6htlkRfHDm4wRlsoFB4Q64cu2FsWzHUAHA3gQU+B6uxht89luK9BJmx8USdulA\nQzVEhS7Tmfk6ZuoRZbgqUqM1BoWEI9vQ8j5XZo/08kzVDwTCPsLEEU2Vx5VtCaKQ\nKhpPds6WFjO4qX5mgDmQ2iR0gsa2jG9Q/preFHEnSZVajbZOhIpyl5P1Fc63k1P5\nO8oQ3otqQBVWF9mkGRO+HGPXASEKwIEaaowdsG+n6qNb3Y9z2rceRYt4IcugR6iB\nfbXbW4ww2RBlZLEd3rkv4VHlTUpvRfjr4naAhFFaWXYJC8jSZV/fOTChHS76Zyxo\n6wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCI6O1MmyK1J8pxZ5qvO4k67zNaydOD\ndmrv7ccFoj2YsMx670f0ehwgOQKA3urRD67YExvehV7mUpmTOAp/CIVaWiqgoWj1\n9290smXF+1aKuBwWJVPtpc4NgF86fYgNZTKgVZxgqld6Gs1dJ798NTo7s1csvMnR\nJMhvUnrgaeLVY8SxmOz2jOLYVWnE45NfwUA6FZZkQkQfczkjZ6qnNDfQ40CiORRp\nojj8wJNsfPInps3NEfNtJj69cUn0ggX7aRj0P5pAS/qeiFDqwrtYjYpot4jLJWMv\nx7zmgApczH0tXzbqHpBQF0kWFfVC9VzvtPXxJLqXU5AbMfV96OMR2znP\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-17T23:19:17.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[38535]: audit 2024-02-17T23:19:16.688574+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCC8/1XVHFPu4iRNUwMZcIIMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMjE3MjMxOTE2WhcN\nMzQwMjE0MjMxOTE2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAuAuVyMiJWznR88E7MSJ4\neh6htlkRfHDm4wRlsoFB4Q64cu2FsWzHUAHA3gQU+B6uxht89luK9BJmx8USdulA\nQzVEhS7Tmfk6ZuoRZbgqUqM1BoWEI9vQ8j5XZo/08kzVDwTCPsLEEU2Vx5VtCaKQ\nKhpPds6WFjO4qX5mgDmQ2iR0gsa2jG9Q/preFHEnSZVajbZOhIpyl5P1Fc63k1P5\nO8oQ3otqQBVWF9mkGRO+HGPXASEKwIEaaowdsG+n6qNb3Y9z2rceRYt4IcugR6iB\nfbXbW4ww2RBlZLEd3rkv4VHlTUpvRfjr4naAhFFaWXYJC8jSZV/fOTChHS76Zyxo\n6wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCI6O1MmyK1J8pxZ5qvO4k67zNaydOD\ndmrv7ccFoj2YsMx670f0ehwgOQKA3urRD67YExvehV7mUpmTOAp/CIVaWiqgoWj1\n9290smXF+1aKuBwWJVPtpc4NgF86fYgNZTKgVZxgqld6Gs1dJ798NTo7s1csvMnR\nJMhvUnrgaeLVY8SxmOz2jOLYVWnE45NfwUA6FZZkQkQfczkjZ6qnNDfQ40CiORRp\nojj8wJNsfPInps3NEfNtJj69cUn0ggX7aRj0P5pAS/qeiFDqwrtYjYpot4jLJWMv\nx7zmgApczH0tXzbqHpBQF0kWFfVC9VzvtPXxJLqXU5AbMfV96OMR2znP\n-----END CERTIFICATE-----\n"}]': finished 2024-02-17T23:19:17.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[38535]: audit 2024-02-17T23:19:16.689144+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQC4C5XIyIlbOdHz\nwTsxInh6HqG2WRF8cObjBGWygUHhDrhy7YWxbMdQAcDeBBT4Hq7GG3z2W4r0EmbH\nxRJ26UBDNUSFLtOZ+Tpm6hFluCpSozUGhYQj29DyPldmj/TyTNUPBMI+wsQRTZXH\nlW0JopAqGk92zpYWM7ipfmaAOZDaJHSCxraMb1D+mt4UcSdJlVqNtk6EinKXk/UV\nzreTU/k7yhDei2pAFVYX2aQZE74cY9cBIQrAgRpqjB2wb6fqo1vdj3Patx5Fi3gh\ny6BHqIF9tdtbjDDZEGVksR3euS/hUeVNSm9F+OvidoCEUVpZdgkLyNJlX985MKEd\nLvpnLGjrAgMBAAECggEAHf1NR+1dbG8MhhKriYMbbJLHOQZkcgmXpdBWnfKwAHM8\nnQWVLmcSRzgx7DtwC0o8om1iPGaISuMgulajfprdbNYmNyl9M27IFHL5qMCMrPCJ\nOGnTMWClOIPuC/lTKZRZd1wIJt/nwQYKbP4tSU+i/ClTX4GkNTPyWDQPkb9Pmivl\nwVUZP7fcTFCDur+yf/xvoq7iuztUi1/0ZkBvHGuwTVWnGrdkXv6YZl3Ov02GiDH/\n55W8GTV7kqQlreLsdRlImgx4n/xmiPjP01+5II6j7PtUX99O+vmkm/Sr05U2UtoZ\n4DALgYX2lXaFRtXIlSCjn8DmeuLWFBCdQWm3ipdYGQKBgQDhp3S9UebSbfFRtyjk\n71a2b8VqJMZjWUUlPJk8D6Ztmg6JNj/gTkOZiNXOem/pqacZENCbsybxZ9RIIKmz\nUaR8Im8CaGiYsx5nLiaB3GnphTgkv/ePs8FlfTVqaysBM5ByfjvyyxcN1nJ+dsUD\nLTt+61n04KAu7AsjpGf7O7AVXQKBgQDQy6t43IkFehW78Wu1TqTFpr0BkctmgnL3\nr3onhNt7pEZRo5WotztZVpps9D0Kap80qNBC9+5WjhNgbqcw1uXzMEDo0UjHp5XS\n7lV+r1TUDeRm60Wk81XdnAkkhcX99ywt+juJmmsncJnRKje1VojQpMuh55Q0LNz3\nXsSf5YmK5wKBgHxEVsKnpuC9kQa6QjgJIgyn8uSoSeSOVcjS3WQ5DiMPku+3Q2gI\nUavssinaPWVFe3MPUoJcH5cT4dCyxCGvVVDTOaTu0KM/CQAzZxtewajLJ4b9fJzT\nli6IzHDFgdJQjjyvDd6APzrsnPLN/2LndvtHKqvzQ+NzNBM1x9mQHkE1AoGAPTrt\nHzV1TVDfHM2Qq4vTkE70cIhj4LzyoCYqqXoxr1GeeYSCeAa79dgK01bQq8RWyeeT\no3/3uhRSJF5u00jCCI4nCt+M+1fu/Pt9wPgD5WfpijEGrHfbv3Bp0fcU+ARLRXRz\nj0fkkp1XzloWGiy1VJJvURyLfr2FU1nMSaPTsRMCgYEA25YDwppH5nxRu3qh1wy9\nN8hpfp4a+IFG/dkaybQjuvh261esHkLFPxLCi2IBCrUt9FnirYFBY4Nd7iBfJaeJ\na0K3RLinbjxFO9NposIAxocIfnnFDVwUycrUs9d3EOv6mgnx8BfeyTQ7cHBT1d8W\nVUGwQEKiOfIXzxjN54kNQQU=\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-17T23:19:17.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[38535]: audit 2024-02-17T23:19:16.691187+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQC4C5XIyIlbOdHz\nwTsxInh6HqG2WRF8cObjBGWygUHhDrhy7YWxbMdQAcDeBBT4Hq7GG3z2W4r0EmbH\nxRJ26UBDNUSFLtOZ+Tpm6hFluCpSozUGhYQj29DyPldmj/TyTNUPBMI+wsQRTZXH\nlW0JopAqGk92zpYWM7ipfmaAOZDaJHSCxraMb1D+mt4UcSdJlVqNtk6EinKXk/UV\nzreTU/k7yhDei2pAFVYX2aQZE74cY9cBIQrAgRpqjB2wb6fqo1vdj3Patx5Fi3gh\ny6BHqIF9tdtbjDDZEGVksR3euS/hUeVNSm9F+OvidoCEUVpZdgkLyNJlX985MKEd\nLvpnLGjrAgMBAAECggEAHf1NR+1dbG8MhhKriYMbbJLHOQZkcgmXpdBWnfKwAHM8\nnQWVLmcSRzgx7DtwC0o8om1iPGaISuMgulajfprdbNYmNyl9M27IFHL5qMCMrPCJ\nOGnTMWClOIPuC/lTKZRZd1wIJt/nwQYKbP4tSU+i/ClTX4GkNTPyWDQPkb9Pmivl\nwVUZP7fcTFCDur+yf/xvoq7iuztUi1/0ZkBvHGuwTVWnGrdkXv6YZl3Ov02GiDH/\n55W8GTV7kqQlreLsdRlImgx4n/xmiPjP01+5II6j7PtUX99O+vmkm/Sr05U2UtoZ\n4DALgYX2lXaFRtXIlSCjn8DmeuLWFBCdQWm3ipdYGQKBgQDhp3S9UebSbfFRtyjk\n71a2b8VqJMZjWUUlPJk8D6Ztmg6JNj/gTkOZiNXOem/pqacZENCbsybxZ9RIIKmz\nUaR8Im8CaGiYsx5nLiaB3GnphTgkv/ePs8FlfTVqaysBM5ByfjvyyxcN1nJ+dsUD\nLTt+61n04KAu7AsjpGf7O7AVXQKBgQDQy6t43IkFehW78Wu1TqTFpr0BkctmgnL3\nr3onhNt7pEZRo5WotztZVpps9D0Kap80qNBC9+5WjhNgbqcw1uXzMEDo0UjHp5XS\n7lV+r1TUDeRm60Wk81XdnAkkhcX99ywt+juJmmsncJnRKje1VojQpMuh55Q0LNz3\nXsSf5YmK5wKBgHxEVsKnpuC9kQa6QjgJIgyn8uSoSeSOVcjS3WQ5DiMPku+3Q2gI\nUavssinaPWVFe3MPUoJcH5cT4dCyxCGvVVDTOaTu0KM/CQAzZxtewajLJ4b9fJzT\nli6IzHDFgdJQjjyvDd6APzrsnPLN/2LndvtHKqvzQ+NzNBM1x9mQHkE1AoGAPTrt\nHzV1TVDfHM2Qq4vTkE70cIhj4LzyoCYqqXoxr1GeeYSCeAa79dgK01bQq8RWyeeT\no3/3uhRSJF5u00jCCI4nCt+M+1fu/Pt9wPgD5WfpijEGrHfbv3Bp0fcU+ARLRXRz\nj0fkkp1XzloWGiy1VJJvURyLfr2FU1nMSaPTsRMCgYEA25YDwppH5nxRu3qh1wy9\nN8hpfp4a+IFG/dkaybQjuvh261esHkLFPxLCi2IBCrUt9FnirYFBY4Nd7iBfJaeJ\na0K3RLinbjxFO9NposIAxocIfnnFDVwUycrUs9d3EOv6mgnx8BfeyTQ7cHBT1d8W\nVUGwQEKiOfIXzxjN54kNQQU=\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-17T23:19:17.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[35193]: audit 2024-02-17T23:19:16.496285+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:19:17.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[35193]: audit 2024-02-17T23:19:16.499160+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:19:17.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[35193]: audit 2024-02-17T23:19:16.685936+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCC8/1XVHFPu4iRNUwMZcIIMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMjE3MjMxOTE2WhcN\nMzQwMjE0MjMxOTE2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAuAuVyMiJWznR88E7MSJ4\neh6htlkRfHDm4wRlsoFB4Q64cu2FsWzHUAHA3gQU+B6uxht89luK9BJmx8USdulA\nQzVEhS7Tmfk6ZuoRZbgqUqM1BoWEI9vQ8j5XZo/08kzVDwTCPsLEEU2Vx5VtCaKQ\nKhpPds6WFjO4qX5mgDmQ2iR0gsa2jG9Q/preFHEnSZVajbZOhIpyl5P1Fc63k1P5\nO8oQ3otqQBVWF9mkGRO+HGPXASEKwIEaaowdsG+n6qNb3Y9z2rceRYt4IcugR6iB\nfbXbW4ww2RBlZLEd3rkv4VHlTUpvRfjr4naAhFFaWXYJC8jSZV/fOTChHS76Zyxo\n6wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCI6O1MmyK1J8pxZ5qvO4k67zNaydOD\ndmrv7ccFoj2YsMx670f0ehwgOQKA3urRD67YExvehV7mUpmTOAp/CIVaWiqgoWj1\n9290smXF+1aKuBwWJVPtpc4NgF86fYgNZTKgVZxgqld6Gs1dJ798NTo7s1csvMnR\nJMhvUnrgaeLVY8SxmOz2jOLYVWnE45NfwUA6FZZkQkQfczkjZ6qnNDfQ40CiORRp\nojj8wJNsfPInps3NEfNtJj69cUn0ggX7aRj0P5pAS/qeiFDqwrtYjYpot4jLJWMv\nx7zmgApczH0tXzbqHpBQF0kWFfVC9VzvtPXxJLqXU5AbMfV96OMR2znP\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-17T23:19:17.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[35193]: audit 2024-02-17T23:19:16.688574+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCC8/1XVHFPu4iRNUwMZcIIMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMjE3MjMxOTE2WhcN\nMzQwMjE0MjMxOTE2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAuAuVyMiJWznR88E7MSJ4\neh6htlkRfHDm4wRlsoFB4Q64cu2FsWzHUAHA3gQU+B6uxht89luK9BJmx8USdulA\nQzVEhS7Tmfk6ZuoRZbgqUqM1BoWEI9vQ8j5XZo/08kzVDwTCPsLEEU2Vx5VtCaKQ\nKhpPds6WFjO4qX5mgDmQ2iR0gsa2jG9Q/preFHEnSZVajbZOhIpyl5P1Fc63k1P5\nO8oQ3otqQBVWF9mkGRO+HGPXASEKwIEaaowdsG+n6qNb3Y9z2rceRYt4IcugR6iB\nfbXbW4ww2RBlZLEd3rkv4VHlTUpvRfjr4naAhFFaWXYJC8jSZV/fOTChHS76Zyxo\n6wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCI6O1MmyK1J8pxZ5qvO4k67zNaydOD\ndmrv7ccFoj2YsMx670f0ehwgOQKA3urRD67YExvehV7mUpmTOAp/CIVaWiqgoWj1\n9290smXF+1aKuBwWJVPtpc4NgF86fYgNZTKgVZxgqld6Gs1dJ798NTo7s1csvMnR\nJMhvUnrgaeLVY8SxmOz2jOLYVWnE45NfwUA6FZZkQkQfczkjZ6qnNDfQ40CiORRp\nojj8wJNsfPInps3NEfNtJj69cUn0ggX7aRj0P5pAS/qeiFDqwrtYjYpot4jLJWMv\nx7zmgApczH0tXzbqHpBQF0kWFfVC9VzvtPXxJLqXU5AbMfV96OMR2znP\n-----END CERTIFICATE-----\n"}]': finished 2024-02-17T23:19:17.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[35193]: audit 2024-02-17T23:19:16.689144+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQC4C5XIyIlbOdHz\nwTsxInh6HqG2WRF8cObjBGWygUHhDrhy7YWxbMdQAcDeBBT4Hq7GG3z2W4r0EmbH\nxRJ26UBDNUSFLtOZ+Tpm6hFluCpSozUGhYQj29DyPldmj/TyTNUPBMI+wsQRTZXH\nlW0JopAqGk92zpYWM7ipfmaAOZDaJHSCxraMb1D+mt4UcSdJlVqNtk6EinKXk/UV\nzreTU/k7yhDei2pAFVYX2aQZE74cY9cBIQrAgRpqjB2wb6fqo1vdj3Patx5Fi3gh\ny6BHqIF9tdtbjDDZEGVksR3euS/hUeVNSm9F+OvidoCEUVpZdgkLyNJlX985MKEd\nLvpnLGjrAgMBAAECggEAHf1NR+1dbG8MhhKriYMbbJLHOQZkcgmXpdBWnfKwAHM8\nnQWVLmcSRzgx7DtwC0o8om1iPGaISuMgulajfprdbNYmNyl9M27IFHL5qMCMrPCJ\nOGnTMWClOIPuC/lTKZRZd1wIJt/nwQYKbP4tSU+i/ClTX4GkNTPyWDQPkb9Pmivl\nwVUZP7fcTFCDur+yf/xvoq7iuztUi1/0ZkBvHGuwTVWnGrdkXv6YZl3Ov02GiDH/\n55W8GTV7kqQlreLsdRlImgx4n/xmiPjP01+5II6j7PtUX99O+vmkm/Sr05U2UtoZ\n4DALgYX2lXaFRtXIlSCjn8DmeuLWFBCdQWm3ipdYGQKBgQDhp3S9UebSbfFRtyjk\n71a2b8VqJMZjWUUlPJk8D6Ztmg6JNj/gTkOZiNXOem/pqacZENCbsybxZ9RIIKmz\nUaR8Im8CaGiYsx5nLiaB3GnphTgkv/ePs8FlfTVqaysBM5ByfjvyyxcN1nJ+dsUD\nLTt+61n04KAu7AsjpGf7O7AVXQKBgQDQy6t43IkFehW78Wu1TqTFpr0BkctmgnL3\nr3onhNt7pEZRo5WotztZVpps9D0Kap80qNBC9+5WjhNgbqcw1uXzMEDo0UjHp5XS\n7lV+r1TUDeRm60Wk81XdnAkkhcX99ywt+juJmmsncJnRKje1VojQpMuh55Q0LNz3\nXsSf5YmK5wKBgHxEVsKnpuC9kQa6QjgJIgyn8uSoSeSOVcjS3WQ5DiMPku+3Q2gI\nUavssinaPWVFe3MPUoJcH5cT4dCyxCGvVVDTOaTu0KM/CQAzZxtewajLJ4b9fJzT\nli6IzHDFgdJQjjyvDd6APzrsnPLN/2LndvtHKqvzQ+NzNBM1x9mQHkE1AoGAPTrt\nHzV1TVDfHM2Qq4vTkE70cIhj4LzyoCYqqXoxr1GeeYSCeAa79dgK01bQq8RWyeeT\no3/3uhRSJF5u00jCCI4nCt+M+1fu/Pt9wPgD5WfpijEGrHfbv3Bp0fcU+ARLRXRz\nj0fkkp1XzloWGiy1VJJvURyLfr2FU1nMSaPTsRMCgYEA25YDwppH5nxRu3qh1wy9\nN8hpfp4a+IFG/dkaybQjuvh261esHkLFPxLCi2IBCrUt9FnirYFBY4Nd7iBfJaeJ\na0K3RLinbjxFO9NposIAxocIfnnFDVwUycrUs9d3EOv6mgnx8BfeyTQ7cHBT1d8W\nVUGwQEKiOfIXzxjN54kNQQU=\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-17T23:19:17.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:16 smithi005 bash[35193]: audit 2024-02-17T23:19:16.691187+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQC4C5XIyIlbOdHz\nwTsxInh6HqG2WRF8cObjBGWygUHhDrhy7YWxbMdQAcDeBBT4Hq7GG3z2W4r0EmbH\nxRJ26UBDNUSFLtOZ+Tpm6hFluCpSozUGhYQj29DyPldmj/TyTNUPBMI+wsQRTZXH\nlW0JopAqGk92zpYWM7ipfmaAOZDaJHSCxraMb1D+mt4UcSdJlVqNtk6EinKXk/UV\nzreTU/k7yhDei2pAFVYX2aQZE74cY9cBIQrAgRpqjB2wb6fqo1vdj3Patx5Fi3gh\ny6BHqIF9tdtbjDDZEGVksR3euS/hUeVNSm9F+OvidoCEUVpZdgkLyNJlX985MKEd\nLvpnLGjrAgMBAAECggEAHf1NR+1dbG8MhhKriYMbbJLHOQZkcgmXpdBWnfKwAHM8\nnQWVLmcSRzgx7DtwC0o8om1iPGaISuMgulajfprdbNYmNyl9M27IFHL5qMCMrPCJ\nOGnTMWClOIPuC/lTKZRZd1wIJt/nwQYKbP4tSU+i/ClTX4GkNTPyWDQPkb9Pmivl\nwVUZP7fcTFCDur+yf/xvoq7iuztUi1/0ZkBvHGuwTVWnGrdkXv6YZl3Ov02GiDH/\n55W8GTV7kqQlreLsdRlImgx4n/xmiPjP01+5II6j7PtUX99O+vmkm/Sr05U2UtoZ\n4DALgYX2lXaFRtXIlSCjn8DmeuLWFBCdQWm3ipdYGQKBgQDhp3S9UebSbfFRtyjk\n71a2b8VqJMZjWUUlPJk8D6Ztmg6JNj/gTkOZiNXOem/pqacZENCbsybxZ9RIIKmz\nUaR8Im8CaGiYsx5nLiaB3GnphTgkv/ePs8FlfTVqaysBM5ByfjvyyxcN1nJ+dsUD\nLTt+61n04KAu7AsjpGf7O7AVXQKBgQDQy6t43IkFehW78Wu1TqTFpr0BkctmgnL3\nr3onhNt7pEZRo5WotztZVpps9D0Kap80qNBC9+5WjhNgbqcw1uXzMEDo0UjHp5XS\n7lV+r1TUDeRm60Wk81XdnAkkhcX99ywt+juJmmsncJnRKje1VojQpMuh55Q0LNz3\nXsSf5YmK5wKBgHxEVsKnpuC9kQa6QjgJIgyn8uSoSeSOVcjS3WQ5DiMPku+3Q2gI\nUavssinaPWVFe3MPUoJcH5cT4dCyxCGvVVDTOaTu0KM/CQAzZxtewajLJ4b9fJzT\nli6IzHDFgdJQjjyvDd6APzrsnPLN/2LndvtHKqvzQ+NzNBM1x9mQHkE1AoGAPTrt\nHzV1TVDfHM2Qq4vTkE70cIhj4LzyoCYqqXoxr1GeeYSCeAa79dgK01bQq8RWyeeT\no3/3uhRSJF5u00jCCI4nCt+M+1fu/Pt9wPgD5WfpijEGrHfbv3Bp0fcU+ARLRXRz\nj0fkkp1XzloWGiy1VJJvURyLfr2FU1nMSaPTsRMCgYEA25YDwppH5nxRu3qh1wy9\nN8hpfp4a+IFG/dkaybQjuvh261esHkLFPxLCi2IBCrUt9FnirYFBY4Nd7iBfJaeJ\na0K3RLinbjxFO9NposIAxocIfnnFDVwUycrUs9d3EOv6mgnx8BfeyTQ7cHBT1d8W\nVUGwQEKiOfIXzxjN54kNQQU=\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-17T23:19:17.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:16 smithi080 bash[35203]: audit 2024-02-17T23:19:16.496285+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:19:17.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:16 smithi080 bash[35203]: audit 2024-02-17T23:19:16.499160+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450628\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450705\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450739\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450770\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450799\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450829\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:17:06.450858\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:19:17.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:16 smithi080 bash[35203]: audit 2024-02-17T23:19:16.685936+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCC8/1XVHFPu4iRNUwMZcIIMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMjE3MjMxOTE2WhcN\nMzQwMjE0MjMxOTE2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAuAuVyMiJWznR88E7MSJ4\neh6htlkRfHDm4wRlsoFB4Q64cu2FsWzHUAHA3gQU+B6uxht89luK9BJmx8USdulA\nQzVEhS7Tmfk6ZuoRZbgqUqM1BoWEI9vQ8j5XZo/08kzVDwTCPsLEEU2Vx5VtCaKQ\nKhpPds6WFjO4qX5mgDmQ2iR0gsa2jG9Q/preFHEnSZVajbZOhIpyl5P1Fc63k1P5\nO8oQ3otqQBVWF9mkGRO+HGPXASEKwIEaaowdsG+n6qNb3Y9z2rceRYt4IcugR6iB\nfbXbW4ww2RBlZLEd3rkv4VHlTUpvRfjr4naAhFFaWXYJC8jSZV/fOTChHS76Zyxo\n6wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCI6O1MmyK1J8pxZ5qvO4k67zNaydOD\ndmrv7ccFoj2YsMx670f0ehwgOQKA3urRD67YExvehV7mUpmTOAp/CIVaWiqgoWj1\n9290smXF+1aKuBwWJVPtpc4NgF86fYgNZTKgVZxgqld6Gs1dJ798NTo7s1csvMnR\nJMhvUnrgaeLVY8SxmOz2jOLYVWnE45NfwUA6FZZkQkQfczkjZ6qnNDfQ40CiORRp\nojj8wJNsfPInps3NEfNtJj69cUn0ggX7aRj0P5pAS/qeiFDqwrtYjYpot4jLJWMv\nx7zmgApczH0tXzbqHpBQF0kWFfVC9VzvtPXxJLqXU5AbMfV96OMR2znP\n-----END CERTIFICATE-----\n"}]: dispatch 2024-02-17T23:19:17.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:16 smithi080 bash[35203]: audit 2024-02-17T23:19:16.688574+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_crt","val":"-----BEGIN CERTIFICATE-----\nMIICxjCCAa4CEQCC8/1XVHFPu4iRNUwMZcIIMA0GCSqGSIb3DQEBDQUAMCExDTAL\nBgNVBAoMBENlcGgxEDAOBgNVBAMMB2NlcGhhZG0wHhcNMjQwMjE3MjMxOTE2WhcN\nMzQwMjE0MjMxOTE2WjAhMQ0wCwYDVQQKDARDZXBoMRAwDgYDVQQDDAdjZXBoYWRt\nMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEAuAuVyMiJWznR88E7MSJ4\neh6htlkRfHDm4wRlsoFB4Q64cu2FsWzHUAHA3gQU+B6uxht89luK9BJmx8USdulA\nQzVEhS7Tmfk6ZuoRZbgqUqM1BoWEI9vQ8j5XZo/08kzVDwTCPsLEEU2Vx5VtCaKQ\nKhpPds6WFjO4qX5mgDmQ2iR0gsa2jG9Q/preFHEnSZVajbZOhIpyl5P1Fc63k1P5\nO8oQ3otqQBVWF9mkGRO+HGPXASEKwIEaaowdsG+n6qNb3Y9z2rceRYt4IcugR6iB\nfbXbW4ww2RBlZLEd3rkv4VHlTUpvRfjr4naAhFFaWXYJC8jSZV/fOTChHS76Zyxo\n6wIDAQABMA0GCSqGSIb3DQEBDQUAA4IBAQCI6O1MmyK1J8pxZ5qvO4k67zNaydOD\ndmrv7ccFoj2YsMx670f0ehwgOQKA3urRD67YExvehV7mUpmTOAp/CIVaWiqgoWj1\n9290smXF+1aKuBwWJVPtpc4NgF86fYgNZTKgVZxgqld6Gs1dJ798NTo7s1csvMnR\nJMhvUnrgaeLVY8SxmOz2jOLYVWnE45NfwUA6FZZkQkQfczkjZ6qnNDfQ40CiORRp\nojj8wJNsfPInps3NEfNtJj69cUn0ggX7aRj0P5pAS/qeiFDqwrtYjYpot4jLJWMv\nx7zmgApczH0tXzbqHpBQF0kWFfVC9VzvtPXxJLqXU5AbMfV96OMR2znP\n-----END CERTIFICATE-----\n"}]': finished 2024-02-17T23:19:17.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:16 smithi080 bash[35203]: audit 2024-02-17T23:19:16.689144+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQC4C5XIyIlbOdHz\nwTsxInh6HqG2WRF8cObjBGWygUHhDrhy7YWxbMdQAcDeBBT4Hq7GG3z2W4r0EmbH\nxRJ26UBDNUSFLtOZ+Tpm6hFluCpSozUGhYQj29DyPldmj/TyTNUPBMI+wsQRTZXH\nlW0JopAqGk92zpYWM7ipfmaAOZDaJHSCxraMb1D+mt4UcSdJlVqNtk6EinKXk/UV\nzreTU/k7yhDei2pAFVYX2aQZE74cY9cBIQrAgRpqjB2wb6fqo1vdj3Patx5Fi3gh\ny6BHqIF9tdtbjDDZEGVksR3euS/hUeVNSm9F+OvidoCEUVpZdgkLyNJlX985MKEd\nLvpnLGjrAgMBAAECggEAHf1NR+1dbG8MhhKriYMbbJLHOQZkcgmXpdBWnfKwAHM8\nnQWVLmcSRzgx7DtwC0o8om1iPGaISuMgulajfprdbNYmNyl9M27IFHL5qMCMrPCJ\nOGnTMWClOIPuC/lTKZRZd1wIJt/nwQYKbP4tSU+i/ClTX4GkNTPyWDQPkb9Pmivl\nwVUZP7fcTFCDur+yf/xvoq7iuztUi1/0ZkBvHGuwTVWnGrdkXv6YZl3Ov02GiDH/\n55W8GTV7kqQlreLsdRlImgx4n/xmiPjP01+5II6j7PtUX99O+vmkm/Sr05U2UtoZ\n4DALgYX2lXaFRtXIlSCjn8DmeuLWFBCdQWm3ipdYGQKBgQDhp3S9UebSbfFRtyjk\n71a2b8VqJMZjWUUlPJk8D6Ztmg6JNj/gTkOZiNXOem/pqacZENCbsybxZ9RIIKmz\nUaR8Im8CaGiYsx5nLiaB3GnphTgkv/ePs8FlfTVqaysBM5ByfjvyyxcN1nJ+dsUD\nLTt+61n04KAu7AsjpGf7O7AVXQKBgQDQy6t43IkFehW78Wu1TqTFpr0BkctmgnL3\nr3onhNt7pEZRo5WotztZVpps9D0Kap80qNBC9+5WjhNgbqcw1uXzMEDo0UjHp5XS\n7lV+r1TUDeRm60Wk81XdnAkkhcX99ywt+juJmmsncJnRKje1VojQpMuh55Q0LNz3\nXsSf5YmK5wKBgHxEVsKnpuC9kQa6QjgJIgyn8uSoSeSOVcjS3WQ5DiMPku+3Q2gI\nUavssinaPWVFe3MPUoJcH5cT4dCyxCGvVVDTOaTu0KM/CQAzZxtewajLJ4b9fJzT\nli6IzHDFgdJQjjyvDd6APzrsnPLN/2LndvtHKqvzQ+NzNBM1x9mQHkE1AoGAPTrt\nHzV1TVDfHM2Qq4vTkE70cIhj4LzyoCYqqXoxr1GeeYSCeAa79dgK01bQq8RWyeeT\no3/3uhRSJF5u00jCCI4nCt+M+1fu/Pt9wPgD5WfpijEGrHfbv3Bp0fcU+ARLRXRz\nj0fkkp1XzloWGiy1VJJvURyLfr2FU1nMSaPTsRMCgYEA25YDwppH5nxRu3qh1wy9\nN8hpfp4a+IFG/dkaybQjuvh261esHkLFPxLCi2IBCrUt9FnirYFBY4Nd7iBfJaeJ\na0K3RLinbjxFO9NposIAxocIfnnFDVwUycrUs9d3EOv6mgnx8BfeyTQ7cHBT1d8W\nVUGwQEKiOfIXzxjN54kNQQU=\n-----END PRIVATE KEY-----\n"}]: dispatch 2024-02-17T23:19:17.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:16 smithi080 bash[35203]: audit 2024-02-17T23:19:16.691187+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/grafana_key","val":"-----BEGIN PRIVATE KEY-----\nMIIEvQIBADANBgkqhkiG9w0BAQEFAASCBKcwggSjAgEAAoIBAQC4C5XIyIlbOdHz\nwTsxInh6HqG2WRF8cObjBGWygUHhDrhy7YWxbMdQAcDeBBT4Hq7GG3z2W4r0EmbH\nxRJ26UBDNUSFLtOZ+Tpm6hFluCpSozUGhYQj29DyPldmj/TyTNUPBMI+wsQRTZXH\nlW0JopAqGk92zpYWM7ipfmaAOZDaJHSCxraMb1D+mt4UcSdJlVqNtk6EinKXk/UV\nzreTU/k7yhDei2pAFVYX2aQZE74cY9cBIQrAgRpqjB2wb6fqo1vdj3Patx5Fi3gh\ny6BHqIF9tdtbjDDZEGVksR3euS/hUeVNSm9F+OvidoCEUVpZdgkLyNJlX985MKEd\nLvpnLGjrAgMBAAECggEAHf1NR+1dbG8MhhKriYMbbJLHOQZkcgmXpdBWnfKwAHM8\nnQWVLmcSRzgx7DtwC0o8om1iPGaISuMgulajfprdbNYmNyl9M27IFHL5qMCMrPCJ\nOGnTMWClOIPuC/lTKZRZd1wIJt/nwQYKbP4tSU+i/ClTX4GkNTPyWDQPkb9Pmivl\nwVUZP7fcTFCDur+yf/xvoq7iuztUi1/0ZkBvHGuwTVWnGrdkXv6YZl3Ov02GiDH/\n55W8GTV7kqQlreLsdRlImgx4n/xmiPjP01+5II6j7PtUX99O+vmkm/Sr05U2UtoZ\n4DALgYX2lXaFRtXIlSCjn8DmeuLWFBCdQWm3ipdYGQKBgQDhp3S9UebSbfFRtyjk\n71a2b8VqJMZjWUUlPJk8D6Ztmg6JNj/gTkOZiNXOem/pqacZENCbsybxZ9RIIKmz\nUaR8Im8CaGiYsx5nLiaB3GnphTgkv/ePs8FlfTVqaysBM5ByfjvyyxcN1nJ+dsUD\nLTt+61n04KAu7AsjpGf7O7AVXQKBgQDQy6t43IkFehW78Wu1TqTFpr0BkctmgnL3\nr3onhNt7pEZRo5WotztZVpps9D0Kap80qNBC9+5WjhNgbqcw1uXzMEDo0UjHp5XS\n7lV+r1TUDeRm60Wk81XdnAkkhcX99ywt+juJmmsncJnRKje1VojQpMuh55Q0LNz3\nXsSf5YmK5wKBgHxEVsKnpuC9kQa6QjgJIgyn8uSoSeSOVcjS3WQ5DiMPku+3Q2gI\nUavssinaPWVFe3MPUoJcH5cT4dCyxCGvVVDTOaTu0KM/CQAzZxtewajLJ4b9fJzT\nli6IzHDFgdJQjjyvDd6APzrsnPLN/2LndvtHKqvzQ+NzNBM1x9mQHkE1AoGAPTrt\nHzV1TVDfHM2Qq4vTkE70cIhj4LzyoCYqqXoxr1GeeYSCeAa79dgK01bQq8RWyeeT\no3/3uhRSJF5u00jCCI4nCt+M+1fu/Pt9wPgD5WfpijEGrHfbv3Bp0fcU+ARLRXRz\nj0fkkp1XzloWGiy1VJJvURyLfr2FU1nMSaPTsRMCgYEA25YDwppH5nxRu3qh1wy9\nN8hpfp4a+IFG/dkaybQjuvh261esHkLFPxLCi2IBCrUt9FnirYFBY4Nd7iBfJaeJ\na0K3RLinbjxFO9NposIAxocIfnnFDVwUycrUs9d3EOv6mgnx8BfeyTQ7cHBT1d8W\nVUGwQEKiOfIXzxjN54kNQQU=\n-----END PRIVATE KEY-----\n"}]': finished 2024-02-17T23:19:17.585 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[48147]: ts=2024-02-17T23:19:17.132Z caller=main.go:245 level=info msg="Starting Alertmanager" version="(version=0.26.0, branch=HEAD, revision=d7b4f0c7322e7151d6e3b1e31cbc15361e295d8d)" 2024-02-17T23:19:17.586 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[48147]: ts=2024-02-17T23:19:17.132Z caller=main.go:246 level=info build_context="(go=go1.20.7, platform=linux/amd64, user=root@df8d7debeef4, date=20230824-11:11:58, tags=netgo)" 2024-02-17T23:19:17.586 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[48147]: ts=2024-02-17T23:19:17.133Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.5 port=9094 2024-02-17T23:19:17.586 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[48147]: ts=2024-02-17T23:19:17.135Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-17T23:19:17.586 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[48147]: ts=2024-02-17T23:19:17.157Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-17T23:19:17.586 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[48147]: ts=2024-02-17T23:19:17.157Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-17T23:19:17.586 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[48147]: ts=2024-02-17T23:19:17.160Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9093 2024-02-17T23:19:17.586 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[48147]: ts=2024-02-17T23:19:17.160Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-17T23:19:17.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[35193]: cluster 2024-02-17T23:19:15.979662+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:17.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[35193]: cephadm 2024-02-17T23:19:16.691641+0000 mgr.y (mgr.14140) 190 : cephadm [INF] Deploying daemon grafana.a on smithi080 2024-02-17T23:19:17.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[38535]: cluster 2024-02-17T23:19:15.979662+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:17.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:17 smithi005 bash[38535]: cephadm 2024-02-17T23:19:16.691641+0000 mgr.y (mgr.14140) 190 : cephadm [INF] Deploying daemon grafana.a on smithi080 2024-02-17T23:19:18.025 INFO:teuthology.orchestra.run.smithi005.stdout:68719476773 2024-02-17T23:19:18.026 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-02-17T23:19:18.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:17 smithi080 bash[35203]: cluster 2024-02-17T23:19:15.979662+0000 mgr.y (mgr.14140) 189 : cluster [DBG] pgmap v186: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:18.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:17 smithi080 bash[35203]: cephadm 2024-02-17T23:19:16.691641+0000 mgr.y (mgr.14140) 190 : cephadm [INF] Deploying daemon grafana.a on smithi080 2024-02-17T23:19:19.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:19 smithi005 bash[48147]: ts=2024-02-17T23:19:19.135Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000303148s 2024-02-17T23:19:19.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:19 smithi005 bash[35193]: cluster 2024-02-17T23:19:17.980065+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:19.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:19 smithi005 bash[38535]: cluster 2024-02-17T23:19:17.980065+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:20.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:19 smithi080 bash[35203]: cluster 2024-02-17T23:19:17.980065+0000 mgr.y (mgr.14140) 191 : cluster [DBG] pgmap v187: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:20.946 INFO:teuthology.orchestra.run.smithi005.stdout:90194313249 2024-02-17T23:19:20.947 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-02-17T23:19:22.075 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:21 smithi005 bash[35193]: cluster 2024-02-17T23:19:19.980571+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:22.075 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:21 smithi005 bash[38535]: cluster 2024-02-17T23:19:19.980571+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:22.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:21 smithi080 bash[35203]: cluster 2024-02-17T23:19:19.980571+0000 mgr.y (mgr.14140) 192 : cluster [DBG] pgmap v188: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:23.877 INFO:teuthology.orchestra.run.smithi005.stdout:111669149725 2024-02-17T23:19:23.877 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-02-17T23:19:24.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:23 smithi005 bash[35193]: cluster 2024-02-17T23:19:21.981070+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:24.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:23 smithi005 bash[38535]: cluster 2024-02-17T23:19:21.981070+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:24.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:23 smithi080 bash[35203]: cluster 2024-02-17T23:19:21.981070+0000 mgr.y (mgr.14140) 193 : cluster [DBG] pgmap v189: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:25.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:25 smithi005 bash[35193]: cluster 2024-02-17T23:19:23.981475+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:25.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:25 smithi005 bash[38535]: cluster 2024-02-17T23:19:23.981475+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:26.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:25 smithi080 bash[35203]: cluster 2024-02-17T23:19:23.981475+0000 mgr.y (mgr.14140) 194 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:26.992 INFO:teuthology.orchestra.run.smithi005.stdout:133143986201 2024-02-17T23:19:26.992 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-02-17T23:19:27.357 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:27 smithi005 bash[48147]: ts=2024-02-17T23:19:27.137Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.00228874s 2024-02-17T23:19:27.875 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:27 smithi005 bash[35193]: cluster 2024-02-17T23:19:25.981847+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:27.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:27 smithi005 bash[38535]: cluster 2024-02-17T23:19:25.981847+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:27 smithi080 bash[35203]: cluster 2024-02-17T23:19:25.981847+0000 mgr.y (mgr.14140) 195 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:29.907 INFO:teuthology.orchestra.run.smithi005.stdout:176093659155 2024-02-17T23:19:29.907 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-02-17T23:19:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:29 smithi005 bash[35193]: cluster 2024-02-17T23:19:27.982406+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:30.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:29 smithi005 bash[38535]: cluster 2024-02-17T23:19:27.982406+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:30.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:29 smithi080 bash[35203]: cluster 2024-02-17T23:19:27.982406+0000 mgr.y (mgr.14140) 196 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:31.799 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:31 smithi005 bash[35193]: cluster 2024-02-17T23:19:29.982744+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:31.799 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:31 smithi005 bash[38535]: cluster 2024-02-17T23:19:29.982744+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:31.844 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:31 smithi080 bash[35203]: cluster 2024-02-17T23:19:29.982744+0000 mgr.y (mgr.14140) 197 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:32.823 INFO:teuthology.orchestra.run.smithi005.stdout:193273528339 2024-02-17T23:19:32.824 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-02-17T23:19:33.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:33 smithi080 bash[35203]: cluster 2024-02-17T23:19:31.983098+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:33 smithi005 bash[35193]: cluster 2024-02-17T23:19:31.983098+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:33 smithi005 bash[38535]: cluster 2024-02-17T23:19:31.983098+0000 mgr.y (mgr.14140) 198 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:34.241 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 systemd[1]: Starting Ceph grafana.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:19:34.600 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 podman[45330]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana.a" found: no such container 2024-02-17T23:19:34.600 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 systemd[1]: Started Ceph grafana.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:19:34.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[35203]: audit 2024-02-17T23:19:34.303668+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:19:34.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[35203]: audit 2024-02-17T23:19:34.306359+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:19:34.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[35203]: audit 2024-02-17T23:19:34.306984+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:19:35.025 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:34 smithi005 bash[35193]: audit 2024-02-17T23:19:34.303668+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:19:35.025 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:34 smithi005 bash[35193]: audit 2024-02-17T23:19:34.306359+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:19:35.025 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:34 smithi005 bash[35193]: audit 2024-02-17T23:19:34.306984+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:19:35.025 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:34 smithi005 bash[38535]: audit 2024-02-17T23:19:34.303668+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:19:35.025 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:34 smithi005 bash[38535]: audit 2024-02-17T23:19:34.306359+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693354\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693435\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693472\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693505\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693537\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693573\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:18:54.693608\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"starting\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:19:35.025 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:34 smithi005 bash[38535]: audit 2024-02-17T23:19:34.306984+0000 mon.a (mon.0) 557 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:19:35.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Starting Grafana" logger=server version=6.6.2 commit=3fa63cfc34 branch=HEAD compiled=2020-02-20T12:03:49+0000 2024-02-17T23:19:35.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-02-17T23:19:35.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-02-17T23:19:35.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-02-17T23:19:35.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-02-17T23:19:35.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-02-17T23:19:35.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-02-17T23:19:35.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-02-17T23:19:35.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="App mode production" logger=settings 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing SqlStore" logger=server 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Starting DB migration" logger=migrator 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-02-17T23:19:35.392 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-02-17T23:19:35.393 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-02-17T23:19:35.394 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-02-17T23:19:35.395 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-02-17T23:19:35.396 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-02-17T23:19:35.397 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-02-17T23:19:35.398 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-02-17T23:19:35.399 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-02-17T23:19:35.400 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-02-17T23:19:35.401 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-02-17T23:19:35.402 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-02-17T23:19:35.403 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-02-17T23:19:35.404 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-02-17T23:19:35.404 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-02-17T23:19:35.404 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-02-17T23:19:35.404 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-17T23:19:35.404 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-02-17T23:19:35.404 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-02-17T23:19:35.404 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-17T23:19:35.405 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-17T23:19:35.406 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-02-17T23:19:35.407 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing HTTPServer" logger=server 2024-02-17T23:19:35.408 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing PluginManager" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Starting plugin search" logger=plugins 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing HooksService" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing RemoteCache" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing QuotaService" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing ServerLockService" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing RenderingService" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing AlertEngine" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2024-02-17T23:19:35.409 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing LoginService" logger=server 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing SearchService" logger=server 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing TracingService" logger=server 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing CleanUpService" logger=server 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing NotificationService" logger=server 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name="Dashboard 1" 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin." logger=rendering renderer=phantomJS 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="Initializing Stream Manager" 2024-02-17T23:19:35.410 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:19:34 smithi080 bash[45346]: t=2024-02-17T23:19:34+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=127.0.0.1:3000 protocol=https subUrl= socket= 2024-02-17T23:19:35.800 INFO:teuthology.orchestra.run.smithi005.stdout:214748364816 2024-02-17T23:19:35.801 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-02-17T23:19:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:35 smithi005 bash[38535]: cluster 2024-02-17T23:19:33.983497+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:35 smithi005 bash[35193]: cluster 2024-02-17T23:19:33.983497+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:36.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:35 smithi080 bash[35203]: cluster 2024-02-17T23:19:33.983497+0000 mgr.y (mgr.14140) 199 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:37.865 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:37 smithi005 bash[35193]: cluster 2024-02-17T23:19:35.983791+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:37.866 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:37 smithi005 bash[38535]: cluster 2024-02-17T23:19:35.983791+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:37 smithi080 bash[35203]: cluster 2024-02-17T23:19:35.983791+0000 mgr.y (mgr.14140) 200 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:38.266 INFO:teuthology.orchestra.run.smithi005.stdout:42949673004 2024-02-17T23:19:39.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:38 smithi005 bash[35193]: audit 2024-02-17T23:19:38.265493+0000 mon.a (mon.0) 558 : audit [DBG] from='client.? 172.21.15.5:0/2419258143' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-17T23:19:39.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:38 smithi005 bash[38535]: audit 2024-02-17T23:19:38.265493+0000 mon.a (mon.0) 558 : audit [DBG] from='client.? 172.21.15.5:0/2419258143' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-17T23:19:39.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:38 smithi080 bash[35203]: audit 2024-02-17T23:19:38.265493+0000 mon.a (mon.0) 558 : audit [DBG] from='client.? 172.21.15.5:0/2419258143' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-02-17T23:19:40.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:39 smithi005 bash[35193]: cluster 2024-02-17T23:19:37.984223+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:40.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:39 smithi005 bash[38535]: cluster 2024-02-17T23:19:37.984223+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:40.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:39 smithi080 bash[35203]: cluster 2024-02-17T23:19:37.984223+0000 mgr.y (mgr.14140) 201 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:40.479 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949672999 got 42949673004 for osd.0 2024-02-17T23:19:40.479 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-02-17T23:19:42.124 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:41 smithi005 bash[38535]: cluster 2024-02-17T23:19:39.984700+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:42.124 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:41 smithi005 bash[35193]: cluster 2024-02-17T23:19:39.984700+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:42.125 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:41 smithi005 bash[38535]: audit 2024-02-17T23:19:41.528576+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"6717a2716a5f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527738\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:16.593350\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_daemon_update\": \"2024-02-17T23:19:41.527828\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:19:42.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:41 smithi005 bash[35193]: audit 2024-02-17T23:19:41.528576+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"6717a2716a5f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527738\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:16.593350\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_daemon_update\": \"2024-02-17T23:19:41.527828\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:19:42.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:41 smithi005 bash[35193]: audit 2024-02-17T23:19:41.531386+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"6717a2716a5f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527738\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:16.593350\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_daemon_update\": \"2024-02-17T23:19:41.527828\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:19:42.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:41 smithi005 bash[35193]: audit 2024-02-17T23:19:41.531933+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:19:42.125 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:41 smithi005 bash[38535]: audit 2024-02-17T23:19:41.531386+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"6717a2716a5f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527738\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:16.593350\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_daemon_update\": \"2024-02-17T23:19:41.527828\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:19:42.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:41 smithi005 bash[38535]: audit 2024-02-17T23:19:41.531933+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:19:42.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:41 smithi080 bash[35203]: cluster 2024-02-17T23:19:39.984700+0000 mgr.y (mgr.14140) 202 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:42.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:41 smithi080 bash[35203]: audit 2024-02-17T23:19:41.528576+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"6717a2716a5f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527738\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:16.593350\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_daemon_update\": \"2024-02-17T23:19:41.527828\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:19:42.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:41 smithi080 bash[35203]: audit 2024-02-17T23:19:41.531386+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"6717a2716a5f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527738\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:16.593350\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.753101\"}}, \"last_daemon_update\": \"2024-02-17T23:19:41.527828\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:19:42.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:41 smithi080 bash[35203]: audit 2024-02-17T23:19:41.531933+0000 mon.a (mon.0) 561 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:19:43.061 INFO:teuthology.orchestra.run.smithi005.stdout:68719476778 2024-02-17T23:19:43.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:43 smithi080 bash[35203]: cluster 2024-02-17T23:19:41.985108+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:43.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:43 smithi080 bash[35203]: audit 2024-02-17T23:19:43.059624+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.5:0/97312994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-17T23:19:43.893 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476773 got 68719476778 for osd.1 2024-02-17T23:19:43.894 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-02-17T23:19:44.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:43 smithi005 bash[38535]: cluster 2024-02-17T23:19:41.985108+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:44.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:43 smithi005 bash[38535]: audit 2024-02-17T23:19:43.059624+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.5:0/97312994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-17T23:19:44.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:43 smithi005 bash[35193]: cluster 2024-02-17T23:19:41.985108+0000 mgr.y (mgr.14140) 203 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:44.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:43 smithi005 bash[35193]: audit 2024-02-17T23:19:43.059624+0000 mon.c (mon.1) 18 : audit [DBG] from='client.? 172.21.15.5:0/97312994' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-02-17T23:19:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:45 smithi005 bash[35193]: cluster 2024-02-17T23:19:43.985389+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:46.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:45 smithi005 bash[38535]: cluster 2024-02-17T23:19:43.985389+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:46.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:45 smithi005 bash[38535]: audit 2024-02-17T23:19:45.451233+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450238\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:19:45.450393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:19:46.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:45 smithi005 bash[38535]: audit 2024-02-17T23:19:45.454478+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450238\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:19:45.450393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:19:46.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:45 smithi005 bash[35193]: audit 2024-02-17T23:19:45.451233+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450238\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:19:45.450393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:19:46.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:45 smithi005 bash[35193]: audit 2024-02-17T23:19:45.454478+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450238\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:19:45.450393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:19:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:45 smithi080 bash[35203]: cluster 2024-02-17T23:19:43.985389+0000 mgr.y (mgr.14140) 204 : cluster [DBG] pgmap v200: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:45 smithi080 bash[35203]: audit 2024-02-17T23:19:45.451233+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450238\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:19:45.450393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:19:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:45 smithi080 bash[35203]: audit 2024-02-17T23:19:45.454478+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"939b05efed60\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450238\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:18:52.409661\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:18:31.896506\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:19:45.450393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:19:46.185 INFO:teuthology.orchestra.run.smithi005.stdout:90194313254 2024-02-17T23:19:46.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:46 smithi005 bash[35193]: cephadm 2024-02-17T23:19:45.456393+0000 mgr.y (mgr.14140) 205 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-17T23:19:46.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:46 smithi005 bash[35193]: cephadm 2024-02-17T23:19:45.458270+0000 mgr.y (mgr.14140) 206 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi005 2024-02-17T23:19:46.991 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:46 smithi005 bash[35193]: audit 2024-02-17T23:19:46.183837+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.5:0/2192435508' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-17T23:19:46.991 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:46 smithi005 bash[38535]: cephadm 2024-02-17T23:19:45.456393+0000 mgr.y (mgr.14140) 205 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-17T23:19:46.991 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:46 smithi005 bash[38535]: cephadm 2024-02-17T23:19:45.458270+0000 mgr.y (mgr.14140) 206 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi005 2024-02-17T23:19:46.991 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:46 smithi005 bash[38535]: audit 2024-02-17T23:19:46.183837+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.5:0/2192435508' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-17T23:19:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:46 smithi080 bash[35203]: cephadm 2024-02-17T23:19:45.456393+0000 mgr.y (mgr.14140) 205 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-17T23:19:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:46 smithi080 bash[35203]: cephadm 2024-02-17T23:19:45.458270+0000 mgr.y (mgr.14140) 206 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi005 2024-02-17T23:19:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:46 smithi080 bash[35203]: audit 2024-02-17T23:19:46.183837+0000 mon.c (mon.1) 19 : audit [DBG] from='client.? 172.21.15.5:0/2192435508' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-02-17T23:19:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:47 smithi005 bash[35193]: cluster 2024-02-17T23:19:45.985734+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:47 smithi005 bash[38535]: cluster 2024-02-17T23:19:45.985734+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:47 smithi080 bash[35203]: cluster 2024-02-17T23:19:45.985734+0000 mgr.y (mgr.14140) 207 : cluster [DBG] pgmap v201: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:48.204 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313249 got 90194313254 for osd.2 2024-02-17T23:19:48.204 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-02-17T23:19:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:49 smithi005 bash[35193]: cluster 2024-02-17T23:19:47.986149+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:50.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:49 smithi005 bash[38535]: cluster 2024-02-17T23:19:47.986149+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:50.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:49 smithi080 bash[35203]: cluster 2024-02-17T23:19:47.986149+0000 mgr.y (mgr.14140) 208 : cluster [DBG] pgmap v202: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:50.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:50 smithi005 systemd[1]: Stopping Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:19:50.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:50 smithi005 bash[48147]: ts=2024-02-17T23:19:50.580Z caller=main.go:594 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-17T23:19:51.355 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 podman[50364]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager.a 2024-02-17T23:19:51.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-17T23:19:51.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: Stopped Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:19:51.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@alertmanager.a.service: Found left-over process 48218 (conmon) in control group while starting unit. Ignoring. 2024-02-17T23:19:51.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-17T23:19:51.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@alertmanager.a.service: Found left-over process 50385 (podman) in control group while starting unit. Ignoring. 2024-02-17T23:19:51.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-17T23:19:51.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: Starting Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:19:51.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 podman[50403]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager.a" found: no such container 2024-02-17T23:19:51.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@alertmanager.a.service: Found left-over process 48218 (conmon) in control group while starting unit. Ignoring. 2024-02-17T23:19:51.627 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-17T23:19:51.627 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@alertmanager.a.service: Found left-over process 50385 (podman) in control group while starting unit. Ignoring. 2024-02-17T23:19:51.627 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2024-02-17T23:19:51.627 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:51 smithi005 systemd[1]: Started Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:19:52.067 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:51 smithi080 bash[35203]: cluster 2024-02-17T23:19:49.986476+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:52.067 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:51 smithi080 bash[35203]: audit 2024-02-17T23:19:51.406938+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:19:52.067 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:51 smithi080 bash[35203]: audit 2024-02-17T23:19:51.410151+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:19:52.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:51 smithi005 bash[35193]: cluster 2024-02-17T23:19:49.986476+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:52.122 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:51 smithi005 bash[38535]: cluster 2024-02-17T23:19:49.986476+0000 mgr.y (mgr.14140) 209 : cluster [DBG] pgmap v203: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:52.123 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:51 smithi005 bash[35193]: audit 2024-02-17T23:19:51.406938+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:19:52.123 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:51 smithi005 bash[35193]: audit 2024-02-17T23:19:51.410151+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:19:52.123 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:51 smithi005 bash[38535]: audit 2024-02-17T23:19:51.406938+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:19:52.123 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:51 smithi005 bash[38535]: audit 2024-02-17T23:19:51.410151+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527428\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527523\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527558\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527589\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527618\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527648\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527678\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:41.527708\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:19:52.645 INFO:teuthology.orchestra.run.smithi005.stdout:111669149730 2024-02-17T23:19:53.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:52 smithi005 bash[35193]: cephadm 2024-02-17T23:19:51.410711+0000 mgr.y (mgr.14140) 210 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-17T23:19:53.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:52 smithi005 bash[35193]: cephadm 2024-02-17T23:19:51.412769+0000 mgr.y (mgr.14140) 211 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi080 2024-02-17T23:19:53.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:52 smithi005 bash[35193]: audit 2024-02-17T23:19:52.548539+0000 mon.a (mon.0) 566 : audit [DBG] from='client.? 172.21.15.5:0/242013582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-17T23:19:53.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:52 smithi005 bash[38535]: cephadm 2024-02-17T23:19:51.410711+0000 mgr.y (mgr.14140) 210 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-17T23:19:53.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:52 smithi005 bash[38535]: cephadm 2024-02-17T23:19:51.412769+0000 mgr.y (mgr.14140) 211 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi080 2024-02-17T23:19:53.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:52 smithi005 bash[38535]: audit 2024-02-17T23:19:52.548539+0000 mon.a (mon.0) 566 : audit [DBG] from='client.? 172.21.15.5:0/242013582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-17T23:19:53.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:52 smithi080 bash[35203]: cephadm 2024-02-17T23:19:51.410711+0000 mgr.y (mgr.14140) 210 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-17T23:19:53.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:52 smithi080 bash[35203]: cephadm 2024-02-17T23:19:51.412769+0000 mgr.y (mgr.14140) 211 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi080 2024-02-17T23:19:53.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:52 smithi080 bash[35203]: audit 2024-02-17T23:19:52.548539+0000 mon.a (mon.0) 566 : audit [DBG] from='client.? 172.21.15.5:0/242013582' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-02-17T23:19:53.625 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:53 smithi005 bash[50425]: ts=2024-02-17T23:19:53.044Z caller=main.go:245 level=info msg="Starting Alertmanager" version="(version=0.26.0, branch=HEAD, revision=d7b4f0c7322e7151d6e3b1e31cbc15361e295d8d)" 2024-02-17T23:19:53.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:53 smithi005 bash[50425]: ts=2024-02-17T23:19:53.044Z caller=main.go:246 level=info build_context="(go=go1.20.7, platform=linux/amd64, user=root@df8d7debeef4, date=20230824-11:11:58, tags=netgo)" 2024-02-17T23:19:53.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:53 smithi005 bash[50425]: ts=2024-02-17T23:19:53.045Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.5 port=9094 2024-02-17T23:19:53.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:53 smithi005 bash[50425]: ts=2024-02-17T23:19:53.046Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-17T23:19:53.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:53 smithi005 bash[50425]: ts=2024-02-17T23:19:53.068Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-17T23:19:53.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:53 smithi005 bash[50425]: ts=2024-02-17T23:19:53.069Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-17T23:19:53.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:53 smithi005 bash[50425]: ts=2024-02-17T23:19:53.071Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9093 2024-02-17T23:19:53.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:53 smithi005 bash[50425]: ts=2024-02-17T23:19:53.071Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-17T23:19:53.641 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149725 got 111669149730 for osd.3 2024-02-17T23:19:53.641 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-02-17T23:19:54.053 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:53 smithi005 bash[35193]: cluster 2024-02-17T23:19:51.986787+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:54.054 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:53 smithi005 bash[38535]: cluster 2024-02-17T23:19:51.986787+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:54.105 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:53 smithi080 bash[35203]: cluster 2024-02-17T23:19:51.986787+0000 mgr.y (mgr.14140) 212 : cluster [DBG] pgmap v204: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:55.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:19:55 smithi005 bash[50425]: ts=2024-02-17T23:19:55.047Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.001054143s 2024-02-17T23:19:55.390 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 systemd[1]: Stopping Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:19:55.391 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.198Z caller=main.go:874 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-17T23:19:55.391 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.198Z caller=main.go:898 level=info msg="Stopping scrape discovery manager..." 2024-02-17T23:19:55.391 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.198Z caller=main.go:912 level=info msg="Stopping notify discovery manager..." 2024-02-17T23:19:55.391 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.198Z caller=manager.go:160 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-17T23:19:55.391 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.198Z caller=manager.go:170 level=info component="rule manager" msg="Rule manager stopped" 2024-02-17T23:19:55.391 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.198Z caller=main.go:949 level=info msg="Stopping scrape manager..." 2024-02-17T23:19:55.391 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.198Z caller=main.go:894 level=info msg="Scrape discovery manager stopped" 2024-02-17T23:19:55.391 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.198Z caller=main.go:908 level=info msg="Notify discovery manager stopped" 2024-02-17T23:19:55.392 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.198Z caller=main.go:941 level=info msg="Scrape manager stopped" 2024-02-17T23:19:55.392 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.199Z caller=notifier.go:604 level=info component=notifier msg="Stopping notification manager..." 2024-02-17T23:19:55.392 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.199Z caller=main.go:1171 level=info msg="Notifier manager stopped" 2024-02-17T23:19:55.392 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[44633]: ts=2024-02-17T23:19:55.199Z caller=main.go:1183 level=info msg="See you next time!" 2024-02-17T23:19:55.762 INFO:teuthology.orchestra.run.smithi005.stdout:133143986207 2024-02-17T23:19:55.830 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[35203]: cluster 2024-02-17T23:19:53.987124+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:55.830 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:55 smithi080 bash[35203]: audit 2024-02-17T23:19:55.760344+0000 mon.a (mon.0) 567 : audit [DBG] from='client.? 172.21.15.5:0/1115429396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-17T23:19:56.082 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:55 smithi080 podman[45975]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus.a 2024-02-17T23:19:56.083 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@prometheus.a.service: Succeeded. 2024-02-17T23:19:56.083 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 systemd[1]: Stopped Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:19:56.083 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 systemd[1]: Starting Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:19:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:55 smithi005 bash[35193]: cluster 2024-02-17T23:19:53.987124+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:55 smithi005 bash[35193]: audit 2024-02-17T23:19:55.760344+0000 mon.a (mon.0) 567 : audit [DBG] from='client.? 172.21.15.5:0/1115429396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-17T23:19:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:55 smithi005 bash[38535]: cluster 2024-02-17T23:19:53.987124+0000 mgr.y (mgr.14140) 213 : cluster [DBG] pgmap v205: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:56.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:55 smithi005 bash[38535]: audit 2024-02-17T23:19:55.760344+0000 mon.a (mon.0) 567 : audit [DBG] from='client.? 172.21.15.5:0/1115429396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-02-17T23:19:56.390 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 podman[46014]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus.a" found: no such container 2024-02-17T23:19:56.390 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 systemd[1]: Started Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:19:56.604 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986201 got 133143986207 for osd.4 2024-02-17T23:19:56.604 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-02-17T23:19:56.847 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:56 smithi005 bash[35193]: audit 2024-02-17T23:19:56.106136+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:19:56.847 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:56 smithi005 bash[35193]: audit 2024-02-17T23:19:56.109198+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:19:56.847 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:56 smithi005 bash[35193]: audit 2024-02-17T23:19:56.109776+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi080:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-17T23:19:56.847 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:56 smithi005 bash[35193]: audit 2024-02-17T23:19:56.115122+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi080:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-17T23:19:56.847 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:56 smithi005 bash[35193]: audit 2024-02-17T23:19:56.117942+0000 mon.a (mon.0) 572 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:19:56.848 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:56 smithi005 bash[38535]: audit 2024-02-17T23:19:56.106136+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:19:56.848 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:56 smithi005 bash[38535]: audit 2024-02-17T23:19:56.109198+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:19:56.848 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:56 smithi005 bash[38535]: audit 2024-02-17T23:19:56.109776+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi080:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-17T23:19:56.848 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:56 smithi005 bash[38535]: audit 2024-02-17T23:19:56.115122+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi080:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-17T23:19:56.848 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:56 smithi005 bash[38535]: audit 2024-02-17T23:19:56.117942+0000 mon.a (mon.0) 572 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:19:57.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.668Z caller=main.go:544 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-17T23:19:57.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.668Z caller=main.go:588 level=info msg="Starting Prometheus Server" mode=server version="(version=2.49.1, branch=HEAD, revision=43e14844a33b65e2a396e3944272af8b3a494071)" 2024-02-17T23:19:57.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.668Z caller=main.go:593 level=info build_context="(go=go1.21.6, platform=linux/amd64, user=root@6d5f4c649d25, date=20240115-16:58:43, tags=netgo,builtinassets,stringlabels)" 2024-02-17T23:19:57.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.668Z caller=main.go:594 level=info host_details="(Linux 4.18.0-539.el8.x86_64 #1 SMP Mon Feb 5 18:34:56 UTC 2024 x86_64 smithi080 (none))" 2024-02-17T23:19:57.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.668Z caller=main.go:595 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-17T23:19:57.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.668Z caller=main.go:596 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-17T23:19:57.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.670Z caller=web.go:565 level=info component=web msg="Start listening for connections" address=:9095 2024-02-17T23:19:57.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.670Z caller=main.go:1039 level=info msg="Starting TSDB ..." 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.671Z caller=tls_config.go:274 level=info component=web msg="Listening on" address=[::]:9095 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.671Z caller=tls_config.go:277 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.674Z caller=head.go:606 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.674Z caller=head.go:687 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.442µs 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.674Z caller=head.go:695 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.674Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.674Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.674Z caller=head.go:803 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=48.35µs wal_replay_duration=301.495µs wbl_replay_duration=123ns total_replay_duration=377.001µs 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.676Z caller=main.go:1060 level=info fs_type=XFS_SUPER_MAGIC 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.676Z caller=main.go:1063 level=info msg="TSDB started" 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.676Z caller=main.go:1245 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.676Z caller=main.go:1282 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=650.608µs db_storage=785ns remote_storage=938ns web_handler=386ns query_engine=586ns scrape=369.588µs scrape_sd=22.652µs notify=23.027µs notify_sd=6.867µs rules=25.488µs tracing=3.97µs 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.676Z caller=main.go:1024 level=info msg="Server is ready to receive web requests." 2024-02-17T23:19:57.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[46029]: ts=2024-02-17T23:19:56.676Z caller=manager.go:146 level=info component="rule manager" msg="Starting rule manager..." 2024-02-17T23:19:57.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[35203]: audit 2024-02-17T23:19:56.106136+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:19:57.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[35203]: audit 2024-02-17T23:19:56.109198+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.449963\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450049\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450103\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450142\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450174\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450206\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"starting\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450270\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:19:45.450300\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:19:57.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[35203]: audit 2024-02-17T23:19:56.109776+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config set","value":"https://smithi080:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]: dispatch 2024-02-17T23:19:57.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[35203]: audit 2024-02-17T23:19:56.115122+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config set","value":"https://smithi080:3000","who":"mgr","name":"mgr/dashboard/GRAFANA_API_URL"}]': finished 2024-02-17T23:19:57.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:56 smithi080 bash[35203]: audit 2024-02-17T23:19:56.117942+0000 mon.a (mon.0) 572 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:19:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:57 smithi005 bash[35193]: cluster 2024-02-17T23:19:55.987440+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:57 smithi005 bash[35193]: cephadm 2024-02-17T23:19:56.109601+0000 mgr.y (mgr.14140) 215 : cephadm [INF] Setting dashboard grafana config to https://smithi080:3000 2024-02-17T23:19:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:57 smithi005 bash[38535]: cluster 2024-02-17T23:19:55.987440+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:57 smithi005 bash[38535]: cephadm 2024-02-17T23:19:56.109601+0000 mgr.y (mgr.14140) 215 : cephadm [INF] Setting dashboard grafana config to https://smithi080:3000 2024-02-17T23:19:58.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:57 smithi080 bash[35203]: cluster 2024-02-17T23:19:55.987440+0000 mgr.y (mgr.14140) 214 : cluster [DBG] pgmap v206: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:57 smithi080 bash[35203]: cephadm 2024-02-17T23:19:56.109601+0000 mgr.y (mgr.14140) 215 : cephadm [INF] Setting dashboard grafana config to https://smithi080:3000 2024-02-17T23:19:59.176 INFO:teuthology.orchestra.run.smithi005.stdout:176093659161 2024-02-17T23:19:59.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:59 smithi005 bash[35193]: cluster 2024-02-17T23:19:57.987765+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:59.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:19:59 smithi005 bash[35193]: audit 2024-02-17T23:19:59.175259+0000 mon.a (mon.0) 573 : audit [DBG] from='client.? 172.21.15.5:0/3592979577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-17T23:19:59.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:59 smithi005 bash[38535]: cluster 2024-02-17T23:19:57.987765+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:19:59.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:19:59 smithi005 bash[38535]: audit 2024-02-17T23:19:59.175259+0000 mon.a (mon.0) 573 : audit [DBG] from='client.? 172.21.15.5:0/3592979577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-17T23:20:00.059 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659155 got 176093659161 for osd.5 2024-02-17T23:20:00.059 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-02-17T23:20:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:59 smithi080 bash[35203]: cluster 2024-02-17T23:19:57.987765+0000 mgr.y (mgr.14140) 216 : cluster [DBG] pgmap v207: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:19:59 smithi080 bash[35203]: audit 2024-02-17T23:19:59.175259+0000 mon.a (mon.0) 573 : audit [DBG] from='client.? 172.21.15.5:0/3592979577' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-02-17T23:20:02.056 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:01 smithi005 bash[35193]: cluster 2024-02-17T23:19:59.988261+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:02.056 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:01 smithi005 bash[38535]: cluster 2024-02-17T23:19:59.988261+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:02.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:01 smithi080 bash[35203]: cluster 2024-02-17T23:19:59.988261+0000 mgr.y (mgr.14140) 217 : cluster [DBG] pgmap v208: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:03.181 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[50425]: ts=2024-02-17T23:20:03.050Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.0033359s 2024-02-17T23:20:03.584 INFO:teuthology.orchestra.run.smithi005.stdout:193273528345 2024-02-17T23:20:03.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[38535]: cluster 2024-02-17T23:20:01.988735+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:03.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[35193]: cluster 2024-02-17T23:20:01.988735+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:03.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[38535]: audit 2024-02-17T23:20:02.931582+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930352\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930446\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930485\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930521\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930554\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930588\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930621\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930654\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930688\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:02.930780\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:03.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[38535]: audit 2024-02-17T23:20:02.934725+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930352\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930446\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930485\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930521\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930554\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930588\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930621\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930654\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930688\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:02.930780\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:03.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[38535]: audit 2024-02-17T23:20:02.935433+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:03.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[38535]: audit 2024-02-17T23:20:03.583249+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.5:0/1156568663' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-17T23:20:03.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[35193]: audit 2024-02-17T23:20:02.931582+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930352\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930446\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930485\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930521\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930554\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930588\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930621\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930654\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930688\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:02.930780\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:03.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[35193]: audit 2024-02-17T23:20:02.934725+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930352\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930446\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930485\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930521\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930554\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930588\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930621\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930654\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930688\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:02.930780\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:03.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[35193]: audit 2024-02-17T23:20:02.935433+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:03.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:03 smithi005 bash[35193]: audit 2024-02-17T23:20:03.583249+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.5:0/1156568663' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-17T23:20:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:03 smithi080 bash[35203]: cluster 2024-02-17T23:20:01.988735+0000 mgr.y (mgr.14140) 218 : cluster [DBG] pgmap v209: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:03 smithi080 bash[35203]: audit 2024-02-17T23:20:02.931582+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930352\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930446\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930485\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930521\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930554\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930588\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930621\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930654\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930688\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:02.930780\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:03 smithi080 bash[35203]: audit 2024-02-17T23:20:02.934725+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930352\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930446\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930485\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930521\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930554\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930588\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930621\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930654\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:02.930688\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:02.930780\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:04.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:03 smithi080 bash[35203]: audit 2024-02-17T23:20:02.935433+0000 mon.a (mon.0) 576 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:04.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:03 smithi080 bash[35203]: audit 2024-02-17T23:20:03.583249+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.5:0/1156568663' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-02-17T23:20:04.505 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528339 got 193273528345 for osd.6 2024-02-17T23:20:04.505 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-02-17T23:20:05.952 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:05 smithi080 bash[35203]: cluster 2024-02-17T23:20:03.989155+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:06.107 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:05 smithi005 bash[35193]: cluster 2024-02-17T23:20:03.989155+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:06.108 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:05 smithi005 bash[38535]: cluster 2024-02-17T23:20:03.989155+0000 mgr.y (mgr.14140) 219 : cluster [DBG] pgmap v210: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:06.787 INFO:teuthology.orchestra.run.smithi005.stdout:214748364822 2024-02-17T23:20:07.633 INFO:tasks.cephadm.ceph_manager.ceph:need seq 214748364816 got 214748364822 for osd.7 2024-02-17T23:20:07.634 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-02-17T23:20:07.634 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-17T23:20:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:07 smithi005 bash[35193]: cluster 2024-02-17T23:20:05.989531+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:07 smithi005 bash[35193]: audit 2024-02-17T23:20:06.785917+0000 mon.a (mon.0) 577 : audit [DBG] from='client.? 172.21.15.5:0/1114736902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-17T23:20:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:07 smithi005 bash[38535]: cluster 2024-02-17T23:20:05.989531+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:07 smithi005 bash[38535]: audit 2024-02-17T23:20:06.785917+0000 mon.a (mon.0) 577 : audit [DBG] from='client.? 172.21.15.5:0/1114736902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-17T23:20:07.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:07 smithi005 bash[35193]: audit 2024-02-17T23:20:06.949085+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.947943\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948018\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948053\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948098\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948131\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948161\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948191\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948220\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948250\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:06.948326\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:07.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:07 smithi005 bash[35193]: audit 2024-02-17T23:20:06.952202+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.947943\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948018\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948053\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948098\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948131\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948161\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948191\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948220\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948250\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:06.948326\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:07.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:07 smithi005 bash[35193]: audit 2024-02-17T23:20:06.954039+0000 mon.a (mon.0) 580 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:07.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:07 smithi005 bash[38535]: audit 2024-02-17T23:20:06.949085+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.947943\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948018\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948053\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948098\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948131\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948161\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948191\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948220\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948250\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:06.948326\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:07.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:07 smithi005 bash[38535]: audit 2024-02-17T23:20:06.952202+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.947943\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948018\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948053\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948098\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948131\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948161\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948191\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948220\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948250\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:06.948326\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:07.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:07 smithi005 bash[38535]: audit 2024-02-17T23:20:06.954039+0000 mon.a (mon.0) 580 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:08.042 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:07 smithi080 bash[35203]: cluster 2024-02-17T23:20:05.989531+0000 mgr.y (mgr.14140) 220 : cluster [DBG] pgmap v211: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:08.042 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:07 smithi080 bash[35203]: audit 2024-02-17T23:20:06.785917+0000 mon.a (mon.0) 577 : audit [DBG] from='client.? 172.21.15.5:0/1114736902' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-02-17T23:20:08.042 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:07 smithi080 bash[35203]: audit 2024-02-17T23:20:06.949085+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.947943\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948018\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948053\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948098\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948131\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948161\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948191\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948220\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948250\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:06.948326\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:08.042 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:07 smithi080 bash[35203]: audit 2024-02-17T23:20:06.952202+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.947943\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948018\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948053\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948098\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948131\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948161\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948191\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948220\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:06.948250\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:06.948326\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:08.042 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:07 smithi080 bash[35203]: audit 2024-02-17T23:20:06.954039+0000 mon.a (mon.0) 580 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:10.043 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:09 smithi005 bash[35193]: cluster 2024-02-17T23:20:07.989871+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:10.043 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:09 smithi005 bash[38535]: cluster 2024-02-17T23:20:07.989871+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:10.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:09 smithi080 bash[35203]: cluster 2024-02-17T23:20:07.989871+0000 mgr.y (mgr.14140) 221 : cluster [DBG] pgmap v212: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:10.454 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:20:10.455 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-02-17T23:20:11.228 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-02-17T23:20:09.990060+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8392604,"kb_used_data":3932,"kb_used_omap":8,"kb_used_meta":8388599,"kb_avail":741568612,"statfs":{"total":767960285184,"available":759366258688,"internally_reserved":8589934592,"allocated":4026368,"data_stored":1600330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8199,"internal_metadata":8589926393},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002449"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"51","state":"active+clean","last_fresh":"2024-02-17T23:18:29.724357+0000","last_change":"2024-02-17T23:18:29.724357+0000","last_active":"2024-02-17T23:18:29.724357+0000","last_peered":"2024-02-17T23:18:29.724357+0000","last_clean":"2024-02-17T23:18:29.724357+0000","last_became_active":"2024-02-17T23:18:29.720517+0000","last_became_peered":"2024-02-17T23:18:29.720517+0000","last_unstale":"2024-02-17T23:18:29.724357+0000","last_undegraded":"2024-02-17T23:18:29.724357+0000","last_fullsized":"2024-02-17T23:18:29.724357+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T23:13:54.612412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T23:13:54.612412+0000","last_clean_scrub_stamp":"2024-02-17T23:13:54.612412+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8199,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364823,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.40000000000000002}]},{"osd":1,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.36599999999999999}]},{"osd":2,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.44800000000000001}]},{"osd":3,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.311},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.42599999999999999}]},{"osd":4,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.47799999999999998}]},{"osd":5,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.47099999999999997}]},{"osd":6,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.439},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51500000000000001}]}]},{"osd":6,"up_from":45,"seq":193273528346,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.57099999999999995}]},{"osd":1,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.46700000000000003}]},{"osd":2,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.58299999999999996}]},{"osd":3,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.442},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.55600000000000005}]},{"osd":4,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.36499999999999999}]},{"osd":5,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.34699999999999998}]},{"osd":7,"last update":"Sat Feb 17 23:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.35699999999999998}]}]},{"osd":1,"up_from":16,"seq":68719476784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.32600000000000001},"min":{"1min":0.26400000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.35099999999999998,"15min":0.33000000000000002},"min":{"1min":0.251,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Feb 17 23:19:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35299999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36899999999999999},"min":{"1min":0.26600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.28299999999999997}]},{"osd":3,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.434,"15min":0.434},"min":{"1min":0.312,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55000000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58999999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Feb 17 23:19:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.69999999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51600000000000001}]},{"osd":5,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68700000000000006,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45000000000000001}]},{"osd":6,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Feb 17 23:19:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.44400000000000001}]}]},{"osd":0,"up_from":10,"seq":42949673011,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 23:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40200000000000002,"15min":0.41599999999999998},"min":{"1min":0.255,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.627,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.158,"15min":0.158},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.311}]},{"osd":2,"last update":"Sat Feb 17 23:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.24199999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.60899999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.39100000000000001},"min":{"1min":0.28199999999999997,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.32800000000000001}]},{"osd":3,"last update":"Sat Feb 17 23:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.40999999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.376},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56899999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.29699999999999999}]},{"osd":4,"last update":"Sat Feb 17 23:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.97099999999999997,"5min":1.077,"15min":1.077},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.624}]},{"osd":5,"last update":"Sat Feb 17 23:20:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.79100000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.34499999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86699999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.67900000000000005}]},{"osd":6,"last update":"Sat Feb 17 23:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Sat Feb 17 23:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.58799999999999997}]}]},{"osd":2,"up_from":21,"seq":90194313259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:53 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35499999999999998,"15min":0.34300000000000003},"min":{"1min":0.23100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36099999999999999,"15min":0.34100000000000003},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.36699999999999999}]},{"osd":1,"last update":"Sat Feb 17 23:19:53 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35299999999999998},"min":{"1min":0.223,"5min":0.217,"15min":0.217},"max":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.255,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.68899999999999995,"5min":1.659,"15min":1.659},"last":0.33400000000000002}]},{"osd":3,"last update":"Sat Feb 17 23:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.39300000000000002}]},{"osd":4,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.72699999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67700000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.48799999999999999}]},{"osd":5,"last update":"Sat Feb 17 23:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.44900000000000001}]},{"osd":6,"last update":"Sat Feb 17 23:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.56399999999999995}]},{"osd":7,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.57599999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149734,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35599999999999998},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":0.56699999999999995,"5min":0.623,"15min":0.623},"last":0.224},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.20499999999999999}]},{"osd":1,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56200000000000006,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.23400000000000001},{"interface":"front","average":{"1min":0.37,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.23899999999999999}]},{"osd":2,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59499999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.19600000000000001}]},{"osd":4,"last update":"Sat Feb 17 23:19:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40699999999999997}]},{"osd":5,"last update":"Sat Feb 17 23:19:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.51600000000000001}]},{"osd":6,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.55200000000000005}]},{"osd":7,"last update":"Sat Feb 17 23:19:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.48399999999999999}]}]},{"osd":4,"up_from":31,"seq":133143986210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.34999999999999998}]},{"osd":1,"last update":"Sat Feb 17 23:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79700000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.38700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.41299999999999998}]},{"osd":2,"last update":"Sat Feb 17 23:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.40400000000000003}]},{"osd":3,"last update":"Sat Feb 17 23:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.747,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35499999999999998}]},{"osd":5,"last update":"Sat Feb 17 23:19:06 2024","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.23999999999999999},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.26000000000000001}]},{"osd":6,"last update":"Sat Feb 17 23:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.28999999999999998}]},{"osd":7,"last update":"Sat Feb 17 23:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.311},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.36299999999999999}]}]},{"osd":5,"up_from":41,"seq":176093659163,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049072,"kb_used_data":488,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":92696080,"statfs":{"total":95995035648,"available":94920785920,"internally_reserved":1073741824,"allocated":499712,"data_stored":199784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8199,"internal_metadata":1073733625},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47799999999999998,"15min":0.48299999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60399999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.47499999999999998}]},{"osd":1,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48799999999999999,"15min":0.497},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58799999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.57499999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47499999999999998,"15min":0.47599999999999998},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63400000000000001,"5min":0.745,"15min":0.745},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64100000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.58099999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.34300000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58999999999999997,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"min":{"1min":0.27100000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.316},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.36399999999999999,"15min":0.35699999999999998},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35199999999999998}]},{"osd":6,"last update":"Sat Feb 17 23:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.33300000000000002}]},{"osd":7,"last update":"Sat Feb 17 23:19:31 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.372},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.379}]}]}]}} 2024-02-17T23:20:11.230 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph pg dump --format=json 2024-02-17T23:20:11.782 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:11 smithi005 bash[35193]: cluster 2024-02-17T23:20:09.990228+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:11.782 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:11 smithi005 bash[35193]: audit 2024-02-17T23:20:10.449993+0000 mgr.y (mgr.14140) 223 : audit [DBG] from='client.24457 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-17T23:20:11.782 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:11 smithi005 bash[38535]: cluster 2024-02-17T23:20:09.990228+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:11.782 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:11 smithi005 bash[38535]: audit 2024-02-17T23:20:10.449993+0000 mgr.y (mgr.14140) 223 : audit [DBG] from='client.24457 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-17T23:20:12.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:11 smithi080 bash[35203]: cluster 2024-02-17T23:20:09.990228+0000 mgr.y (mgr.14140) 222 : cluster [DBG] pgmap v213: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:12.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:11 smithi080 bash[35203]: audit 2024-02-17T23:20:10.449993+0000 mgr.y (mgr.14140) 223 : audit [DBG] from='client.24457 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-17T23:20:14.025 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:20:14.026 INFO:teuthology.orchestra.run.smithi005.stderr:dumped all 2024-02-17T23:20:14.052 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:13 smithi005 bash[35193]: cluster 2024-02-17T23:20:11.990703+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:14.053 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:13 smithi005 bash[38535]: cluster 2024-02-17T23:20:11.990703+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:13 smithi080 bash[35203]: cluster 2024-02-17T23:20:11.990703+0000 mgr.y (mgr.14140) 224 : cluster [DBG] pgmap v214: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:14.916 INFO:teuthology.orchestra.run.smithi005.stdout:{"pg_ready":true,"pg_map":{"version":215,"stamp":"2024-02-17T23:20:13.990894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":8392604,"kb_used_data":3932,"kb_used_omap":8,"kb_used_meta":8388599,"kb_avail":741568612,"statfs":{"total":767960285184,"available":759366258688,"internally_reserved":8589934592,"allocated":4026368,"data_stored":1600330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8199,"internal_metadata":8589926393},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002415"},"pg_stats":[{"pgid":"1.0","version":"17'1","reported_seq":"14","reported_epoch":"51","state":"active+clean","last_fresh":"2024-02-17T23:18:29.724357+0000","last_change":"2024-02-17T23:18:29.724357+0000","last_active":"2024-02-17T23:18:29.724357+0000","last_peered":"2024-02-17T23:18:29.724357+0000","last_clean":"2024-02-17T23:18:29.724357+0000","last_became_active":"2024-02-17T23:18:29.720517+0000","last_became_peered":"2024-02-17T23:18:29.720517+0000","last_unstale":"2024-02-17T23:18:29.724357+0000","last_undegraded":"2024-02-17T23:18:29.724357+0000","last_fullsized":"2024-02-17T23:18:29.724357+0000","mapping_epoch":50,"log_start":"0'0","ondisk_log_start":"0'0","created":2,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-02-17T23:13:54.612412+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-02-17T23:13:54.612412+0000","last_clean_scrub_stamp":"2024-02-17T23:13:54.612412+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8199,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":50,"seq":214748364824,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.501,"15min":0.501},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.54100000000000004}]},{"osd":2,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.54800000000000004}]},{"osd":3,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.59899999999999998}]},{"osd":4,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.438},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.44600000000000001}]},{"osd":5,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.441,"15min":0.441},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.496}]},{"osd":6,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51800000000000002}]}]},{"osd":6,"up_from":45,"seq":193273528347,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.626,"5min":0.626,"15min":0.626},"last":0.497},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.62}]},{"osd":1,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.44,"15min":0.44},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.505},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.45700000000000002}]},{"osd":2,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.47299999999999998}]},{"osd":3,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.52800000000000002}]},{"osd":4,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.435},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.39500000000000002}]},{"osd":5,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.60299999999999998}]},{"osd":7,"last update":"Sat Feb 17 23:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.53600000000000003}]}]},{"osd":1,"up_from":16,"seq":68719476784,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:34 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.32600000000000001},"min":{"1min":0.26400000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.35099999999999998,"15min":0.33000000000000002},"min":{"1min":0.251,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"last":0.26600000000000001}]},{"osd":2,"last update":"Sat Feb 17 23:19:54 2024","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.35299999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36899999999999999},"min":{"1min":0.26600000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.56699999999999995},"last":0.28299999999999997}]},{"osd":3,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.434,"15min":0.434},"min":{"1min":0.312,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.55000000000000004,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.39600000000000002,"5min":0.40699999999999997,"15min":0.40899999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58999999999999997,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.40999999999999998}]},{"osd":4,"last update":"Sat Feb 17 23:19:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68700000000000006,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57299999999999995,"15min":0.57199999999999995},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.69999999999999996,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51600000000000001}]},{"osd":5,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.68600000000000005,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56599999999999995,"15min":0.56999999999999995},"min":{"1min":0.40300000000000002,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.68700000000000006,"5min":0.71899999999999997,"15min":0.71899999999999997},"last":0.45000000000000001}]},{"osd":6,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.52800000000000002}]},{"osd":7,"last update":"Sat Feb 17 23:19:31 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.44400000000000001}]}]},{"osd":0,"up_from":10,"seq":42949673012,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 17 23:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.40200000000000002,"15min":0.41599999999999998},"min":{"1min":0.255,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.627,"5min":2.2749999999999999,"15min":2.2749999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.158,"15min":0.158},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.41699999999999998}]},{"osd":2,"last update":"Sat Feb 17 23:19:50 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.38100000000000001,"15min":0.377},"min":{"1min":0.24199999999999999,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.60899999999999999,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.39400000000000002,"15min":0.39100000000000001},"min":{"1min":0.28199999999999997,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.43099999999999999}]},{"osd":3,"last update":"Sat Feb 17 23:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.41299999999999998,"15min":0.40999999999999998},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.441,"15min":0.44400000000000001},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56899999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.44500000000000001}]},{"osd":4,"last update":"Sat Feb 17 23:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.56999999999999995,"15min":0.56399999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.97099999999999997,"5min":1.077,"15min":1.077},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55700000000000005,"15min":0.55400000000000005},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.71099999999999997}]},{"osd":5,"last update":"Sat Feb 17 23:20:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38900000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.79100000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.59099999999999997,"15min":0.59399999999999997},"min":{"1min":0.34499999999999997,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.86699999999999999,"5min":1.1180000000000001,"15min":1.1180000000000001},"last":0.622}]},{"osd":6,"last update":"Sat Feb 17 23:19:16 2024","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.626},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Sat Feb 17 23:19:33 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.77900000000000003}]}]},{"osd":2,"up_from":21,"seq":90194313260,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:53 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35499999999999998,"15min":0.34300000000000003},"min":{"1min":0.23100000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.36099999999999999,"15min":0.34100000000000003},"min":{"1min":0.26800000000000002,"5min":0.217,"15min":0.217},"max":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"last":0.45800000000000002}]},{"osd":1,"last update":"Sat Feb 17 23:19:53 2024","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35299999999999998},"min":{"1min":0.223,"5min":0.217,"15min":0.217},"max":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.373},"min":{"1min":0.255,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.68899999999999995,"5min":1.659,"15min":1.659},"last":0.42599999999999999}]},{"osd":3,"last update":"Sat Feb 17 23:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.42499999999999999,"15min":0.42999999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.46700000000000003,"15min":0.46999999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.60799999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.47999999999999998}]},{"osd":4,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.72699999999999998,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.626},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67700000000000005,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.57899999999999996}]},{"osd":5,"last update":"Sat Feb 17 23:20:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.38800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.51600000000000001,"15min":0.50600000000000001},"min":{"1min":0.42999999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.66100000000000003}]},{"osd":6,"last update":"Sat Feb 17 23:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.60099999999999998}]},{"osd":7,"last update":"Sat Feb 17 23:19:30 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.55100000000000005}]}]},{"osd":3,"up_from":26,"seq":111669149735,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35599999999999998},"min":{"1min":0.153,"5min":0.153,"15min":0.153},"max":{"1min":0.56699999999999995,"5min":0.623,"15min":0.623},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.192,"5min":0.192,"15min":0.192},"max":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"last":0.34499999999999997}]},{"osd":1,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.39800000000000002,"15min":0.40100000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.56200000000000006,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.38500000000000001,"15min":0.38700000000000001},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.32000000000000001}]},{"osd":2,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.39800000000000002,"15min":0.39900000000000002},"min":{"1min":0.20799999999999999,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.59499999999999997,"5min":0.63900000000000001,"15min":0.63900000000000001},"last":0.40400000000000003}]},{"osd":4,"last update":"Sat Feb 17 23:19:32 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54000000000000004,"15min":0.54200000000000004},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.747,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.376},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.70399999999999996,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45100000000000001}]},{"osd":5,"last update":"Sat Feb 17 23:20:08 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54700000000000004,"15min":0.55400000000000005},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.65600000000000003,"5min":0.748,"15min":0.748},"last":0.434},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54900000000000004,"15min":0.55100000000000005},"min":{"1min":0.40100000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.438}]},{"osd":6,"last update":"Sat Feb 17 23:19:13 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.41799999999999998}]},{"osd":7,"last update":"Sat Feb 17 23:19:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.379},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.38600000000000001}]}]},{"osd":4,"up_from":31,"seq":133143986211,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049076,"kb_used_data":492,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92696076,"statfs":{"total":95995035648,"available":94920781824,"internally_reserved":1073741824,"allocated":503808,"data_stored":200078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":1.1299999999999999,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52900000000000003,"15min":0.53200000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.91900000000000004,"5min":0.96299999999999997,"15min":0.96299999999999997},"last":0.40300000000000002}]},{"osd":1,"last update":"Sat Feb 17 23:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.505,"15min":0.50800000000000001},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.79700000000000004,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.434},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.38700000000000001,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.109,"5min":1.109,"15min":1.109},"last":0.46000000000000002}]},{"osd":2,"last update":"Sat Feb 17 23:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.378},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.52200000000000002,"15min":0.52400000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.442}]},{"osd":3,"last update":"Sat Feb 17 23:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.32700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.53500000000000003,"15min":0.54000000000000004},"min":{"1min":0.39900000000000002,"5min":0.379,"15min":0.379},"max":{"1min":0.747,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.51400000000000001}]},{"osd":5,"last update":"Sat Feb 17 23:20:09 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.61199999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.38800000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.65200000000000002,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.46600000000000003}]},{"osd":6,"last update":"Sat Feb 17 23:19:12 2024","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.501},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.371}]},{"osd":7,"last update":"Sat Feb 17 23:19:29 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.41399999999999998}]}]},{"osd":5,"up_from":41,"seq":176093659164,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":1049072,"kb_used_data":488,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":92696080,"statfs":{"total":95995035648,"available":94920785920,"internally_reserved":1073741824,"allocated":499712,"data_stored":199784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8199,"internal_metadata":1073733625},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.47799999999999998,"15min":0.48299999999999998},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.60399999999999998,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.47499999999999998}]},{"osd":1,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.48799999999999999,"15min":0.497},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.58799999999999997,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.35599999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.57499999999999996,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.57399999999999995}]},{"osd":2,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47499999999999998,"15min":0.47599999999999998},"min":{"1min":0.34699999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.63400000000000001,"5min":0.745,"15min":0.745},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.64100000000000001,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.52600000000000002}]},{"osd":3,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.48199999999999998,"15min":0.48699999999999999},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.58099999999999996,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.48399999999999999,"15min":0.48599999999999999},"min":{"1min":0.34300000000000003,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58999999999999997,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.51300000000000001}]},{"osd":4,"last update":"Sat Feb 17 23:20:07 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35399999999999998,"15min":0.34999999999999998},"min":{"1min":0.27100000000000002,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.316},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.36399999999999999,"15min":0.35699999999999998},"min":{"1min":0.26800000000000002,"5min":0.22,"15min":0.22},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35199999999999998}]},{"osd":6,"last update":"Sat Feb 17 23:19:11 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.33300000000000002}]},{"osd":7,"last update":"Sat Feb 17 23:19:31 2024","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.372},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.379}]}]}]}} 2024-02-17T23:20:14.917 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-02-17T23:20:14.918 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-02-17T23:20:14.918 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-02-17T23:20:14.918 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- ceph health --format=json 2024-02-17T23:20:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:15 smithi080 bash[35203]: cluster 2024-02-17T23:20:13.991024+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:15 smithi080 bash[35203]: audit 2024-02-17T23:20:14.020966+0000 mgr.y (mgr.14140) 226 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-17T23:20:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:15 smithi080 bash[35203]: audit 2024-02-17T23:20:15.440166+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:15.439393\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:15 smithi080 bash[35203]: audit 2024-02-17T23:20:15.443107+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:15.439393\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:15 smithi080 bash[35203]: audit 2024-02-17T23:20:15.443699+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:15 smithi005 bash[35193]: cluster 2024-02-17T23:20:13.991024+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:15 smithi005 bash[35193]: audit 2024-02-17T23:20:14.020966+0000 mgr.y (mgr.14140) 226 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-17T23:20:16.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:15 smithi005 bash[38535]: cluster 2024-02-17T23:20:13.991024+0000 mgr.y (mgr.14140) 225 : cluster [DBG] pgmap v215: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:16.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:15 smithi005 bash[38535]: audit 2024-02-17T23:20:14.020966+0000 mgr.y (mgr.14140) 226 : audit [DBG] from='client.14550 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-02-17T23:20:16.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:15 smithi005 bash[38535]: audit 2024-02-17T23:20:15.440166+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:15.439393\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:16.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:15 smithi005 bash[38535]: audit 2024-02-17T23:20:15.443107+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:15.439393\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:16.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:15 smithi005 bash[38535]: audit 2024-02-17T23:20:15.443699+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:16.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:15 smithi005 bash[35193]: audit 2024-02-17T23:20:15.440166+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:15.439393\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:16.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:15 smithi005 bash[35193]: audit 2024-02-17T23:20:15.443107+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}}, \"last_daemon_update\": \"2024-02-17T23:20:15.439393\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:16.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:15 smithi005 bash[35193]: audit 2024-02-17T23:20:15.443699+0000 mon.a (mon.0) 583 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:17.676 INFO:teuthology.orchestra.run.smithi005.stdout: 2024-02-17T23:20:17.990 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:17 smithi080 bash[35203]: cluster 2024-02-17T23:20:15.991284+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:17.990 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:17 smithi080 bash[35203]: audit 2024-02-17T23:20:17.675171+0000 mon.a (mon.0) 584 : audit [DBG] from='client.? 172.21.15.5:0/3561297716' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-17T23:20:18.038 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:17 smithi005 bash[35193]: cluster 2024-02-17T23:20:15.991284+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:18.038 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:17 smithi005 bash[35193]: audit 2024-02-17T23:20:17.675171+0000 mon.a (mon.0) 584 : audit [DBG] from='client.? 172.21.15.5:0/3561297716' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-17T23:20:18.038 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:17 smithi005 bash[38535]: cluster 2024-02-17T23:20:15.991284+0000 mgr.y (mgr.14140) 227 : cluster [DBG] pgmap v216: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:18.038 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:17 smithi005 bash[38535]: audit 2024-02-17T23:20:17.675171+0000 mon.a (mon.0) 584 : audit [DBG] from='client.? 172.21.15.5:0/3561297716' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-02-17T23:20:18.323 INFO:teuthology.orchestra.run.smithi005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-02-17T23:20:18.323 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-02-17T23:20:18.324 INFO:tasks.cephadm:Setup complete, yielding 2024-02-17T23:20:18.324 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-17T23:20:18.334 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-02-17T23:20:18.335 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-02-17T23:20:19.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:19 smithi005 bash[35193]: cluster 2024-02-17T23:20:17.991595+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:19.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:19 smithi005 bash[38535]: cluster 2024-02-17T23:20:17.991595+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:19.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:19 smithi005 bash[35193]: audit 2024-02-17T23:20:18.996533+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:18.995772\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:19.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:19 smithi005 bash[35193]: audit 2024-02-17T23:20:18.999338+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:18.995772\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:19.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:19 smithi005 bash[38535]: audit 2024-02-17T23:20:18.996533+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:18.995772\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:19.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:19 smithi005 bash[38535]: audit 2024-02-17T23:20:18.999338+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:18.995772\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:20.042 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:19 smithi080 bash[35203]: cluster 2024-02-17T23:20:17.991595+0000 mgr.y (mgr.14140) 228 : cluster [DBG] pgmap v217: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:20.042 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:19 smithi080 bash[35203]: audit 2024-02-17T23:20:18.996533+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:18.995772\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:20.042 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:19 smithi080 bash[35203]: audit 2024-02-17T23:20:18.999338+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}}, \"last_daemon_update\": \"2024-02-17T23:20:18.995772\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:21.864 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:20:21.864 INFO:teuthology.orchestra.run.smithi005.stdout: "id": "13bbdd3f-89fb-451e-9897-8b7e9e59c026", 2024-02-17T23:20:21.864 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "r", 2024-02-17T23:20:21.864 INFO:teuthology.orchestra.run.smithi005.stdout: "current_period": "530caed9-e29b-458a-9c80-3b5ffc52bb03", 2024-02-17T23:20:21.864 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1 2024-02-17T23:20:21.864 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:20:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:21 smithi005 bash[35193]: cluster 2024-02-17T23:20:19.991952+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:21 smithi005 bash[35193]: cluster 2024-02-17T23:20:20.827058+0000 mon.a (mon.0) 587 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-17T23:20:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:21 smithi005 bash[35193]: audit 2024-02-17T23:20:20.827985+0000 mon.a (mon.0) 588 : audit [INF] from='client.? 172.21.15.5:0/1644056267' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-17T23:20:22.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:21 smithi005 bash[38535]: cluster 2024-02-17T23:20:19.991952+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:22.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:21 smithi005 bash[38535]: cluster 2024-02-17T23:20:20.827058+0000 mon.a (mon.0) 587 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-17T23:20:22.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:21 smithi005 bash[38535]: audit 2024-02-17T23:20:20.827985+0000 mon.a (mon.0) 588 : audit [INF] from='client.? 172.21.15.5:0/1644056267' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-17T23:20:22.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:21 smithi080 bash[35203]: cluster 2024-02-17T23:20:19.991952+0000 mgr.y (mgr.14140) 229 : cluster [DBG] pgmap v218: 1 pgs: 1 active+clean; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:22.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:21 smithi080 bash[35203]: cluster 2024-02-17T23:20:20.827058+0000 mon.a (mon.0) 587 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2024-02-17T23:20:22.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:21 smithi080 bash[35203]: audit 2024-02-17T23:20:20.827985+0000 mon.a (mon.0) 588 : audit [INF] from='client.? 172.21.15.5:0/1644056267' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-02-17T23:20:22.707 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-02-17T23:20:23.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:22 smithi005 bash[35193]: audit 2024-02-17T23:20:21.829210+0000 mon.a (mon.0) 589 : audit [INF] from='client.? 172.21.15.5:0/1644056267' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-17T23:20:23.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:22 smithi005 bash[35193]: cluster 2024-02-17T23:20:21.829379+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-17T23:20:23.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:22 smithi005 bash[35193]: cluster 2024-02-17T23:20:21.992394+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v221: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:23.122 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:22 smithi005 bash[38535]: audit 2024-02-17T23:20:21.829210+0000 mon.a (mon.0) 589 : audit [INF] from='client.? 172.21.15.5:0/1644056267' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-17T23:20:23.122 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:22 smithi005 bash[38535]: cluster 2024-02-17T23:20:21.829379+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-17T23:20:23.122 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:22 smithi005 bash[38535]: cluster 2024-02-17T23:20:21.992394+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v221: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:23.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:22 smithi080 bash[35203]: audit 2024-02-17T23:20:21.829210+0000 mon.a (mon.0) 589 : audit [INF] from='client.? 172.21.15.5:0/1644056267' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-02-17T23:20:23.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:22 smithi080 bash[35203]: cluster 2024-02-17T23:20:21.829379+0000 mon.a (mon.0) 590 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2024-02-17T23:20:23.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:22 smithi080 bash[35203]: cluster 2024-02-17T23:20:21.992394+0000 mgr.y (mgr.14140) 230 : cluster [DBG] pgmap v221: 33 pgs: 6 creating+peering, 1 active+clean, 26 unknown; 0 B data, 3.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:20:24.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:23 smithi005 bash[35193]: cluster 2024-02-17T23:20:22.836091+0000 mon.a (mon.0) 591 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-17T23:20:24.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:23 smithi005 bash[38535]: cluster 2024-02-17T23:20:22.836091+0000 mon.a (mon.0) 591 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-17T23:20:24.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:23 smithi080 bash[35203]: cluster 2024-02-17T23:20:22.836091+0000 mon.a (mon.0) 591 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "id": "ac5cf3db-de60-4cc8-b03d-7f8a1402acbb", 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default", 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "api_name": "default", 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "is_master": "true", 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "endpoints": [], 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "hostnames": [], 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "hostnames_s3website": [], 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "master_zone": "", 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "zones": [], 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_targets": [], 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "default_placement": "", 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "realm_id": "13bbdd3f-89fb-451e-9897-8b7e9e59c026", 2024-02-17T23:20:24.730 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_policy": { 2024-02-17T23:20:24.731 INFO:teuthology.orchestra.run.smithi005.stdout: "groups": [] 2024-02-17T23:20:24.731 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:20:24.731 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:20:25.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:24 smithi005 bash[35193]: cluster 2024-02-17T23:20:23.992750+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v223: 33 pgs: 6 creating+peering, 18 active+clean, 9 unknown; 299 B data, 4.1 MiB used, 707 GiB / 715 GiB avail; 682 B/s wr, 0 op/s 2024-02-17T23:20:25.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:24 smithi005 bash[38535]: cluster 2024-02-17T23:20:23.992750+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v223: 33 pgs: 6 creating+peering, 18 active+clean, 9 unknown; 299 B data, 4.1 MiB used, 707 GiB / 715 GiB avail; 682 B/s wr, 0 op/s 2024-02-17T23:20:25.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:24 smithi080 bash[35203]: cluster 2024-02-17T23:20:23.992750+0000 mgr.y (mgr.14140) 231 : cluster [DBG] pgmap v223: 33 pgs: 6 creating+peering, 18 active+clean, 9 unknown; 299 B data, 4.1 MiB used, 707 GiB / 715 GiB avail; 682 B/s wr, 0 op/s 2024-02-17T23:20:25.428 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-02-17T23:20:27.335 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:27 smithi005 bash[35193]: cluster 2024-02-17T23:20:25.993174+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v224: 33 pgs: 6 creating+peering, 27 active+clean; 516 B data, 4.2 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 1 op/s 2024-02-17T23:20:27.336 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:27 smithi005 bash[38535]: cluster 2024-02-17T23:20:25.993174+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v224: 33 pgs: 6 creating+peering, 27 active+clean; 516 B data, 4.2 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 1 op/s 2024-02-17T23:20:27.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:27 smithi080 bash[35203]: cluster 2024-02-17T23:20:25.993174+0000 mgr.y (mgr.14140) 232 : cluster [DBG] pgmap v224: 33 pgs: 6 creating+peering, 27 active+clean; 516 B data, 4.2 MiB used, 707 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 1 op/s 2024-02-17T23:20:27.609 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:20:27.609 INFO:teuthology.orchestra.run.smithi005.stdout: "id": "82d65cbe-669b-45b0-a956-08f3b8cf6474", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "z", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "domain_root": "z.rgw.meta:root", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "control_pool": "z.rgw.control", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "gc_pool": "z.rgw.log:gc", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "lc_pool": "z.rgw.log:lc", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "log_pool": "z.rgw.log", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "roles_pool": "z.rgw.meta:roles", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-02-17T23:20:27.610 INFO:teuthology.orchestra.run.smithi005.stdout: "otp_pool": "z.rgw.otp", 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "system_key": { 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "access_key": "", 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "secret_key": "" 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_pools": [ 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "default-placement", 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "val": { 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "index_pool": "z.rgw.buckets.index", 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_classes": { 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "STANDARD": { 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "data_pool": "z.rgw.buckets.data" 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:20:27.611 INFO:teuthology.orchestra.run.smithi005.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-02-17T23:20:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: "index_type": 0 2024-02-17T23:20:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:20:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:20:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:20:27.612 INFO:teuthology.orchestra.run.smithi005.stdout: "realm_id": "13bbdd3f-89fb-451e-9897-8b7e9e59c026" 2024-02-17T23:20:27.612 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:20:28.216 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-02-17T23:20:29.906 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:29 smithi005 bash[35193]: cluster 2024-02-17T23:20:27.993588+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v225: 33 pgs: 33 active+clean; 608 B data, 4.3 MiB used, 707 GiB / 715 GiB avail; 285 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-02-17T23:20:29.906 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:29 smithi005 bash[38535]: cluster 2024-02-17T23:20:27.993588+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v225: 33 pgs: 33 active+clean; 608 B data, 4.3 MiB used, 707 GiB / 715 GiB avail; 285 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-02-17T23:20:30.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:29 smithi080 bash[35203]: cluster 2024-02-17T23:20:27.993588+0000 mgr.y (mgr.14140) 233 : cluster [DBG] pgmap v225: 33 pgs: 33 active+clean; 608 B data, 4.3 MiB used, 707 GiB / 715 GiB avail; 285 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-02-17T23:20:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:31 smithi005 bash[35193]: cluster 2024-02-17T23:20:29.993979+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v226: 33 pgs: 33 active+clean; 1.8 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 501 B/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-17T23:20:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:31 smithi005 bash[35193]: cluster 2024-02-17T23:20:30.703940+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-17T23:20:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:31 smithi005 bash[35193]: audit 2024-02-17T23:20:30.704655+0000 mon.c (mon.1) 21 : audit [INF] from='client.? 172.21.15.5:0/546734377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-17T23:20:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:31 smithi005 bash[35193]: audit 2024-02-17T23:20:30.705304+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-17T23:20:32.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:31 smithi005 bash[38535]: cluster 2024-02-17T23:20:29.993979+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v226: 33 pgs: 33 active+clean; 1.8 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 501 B/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-17T23:20:32.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:31 smithi005 bash[38535]: cluster 2024-02-17T23:20:30.703940+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-17T23:20:32.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:31 smithi005 bash[38535]: audit 2024-02-17T23:20:30.704655+0000 mon.c (mon.1) 21 : audit [INF] from='client.? 172.21.15.5:0/546734377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-17T23:20:32.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:31 smithi005 bash[38535]: audit 2024-02-17T23:20:30.705304+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-17T23:20:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:31 smithi080 bash[35203]: cluster 2024-02-17T23:20:29.993979+0000 mgr.y (mgr.14140) 234 : cluster [DBG] pgmap v226: 33 pgs: 33 active+clean; 1.8 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 501 B/s rd, 2.0 KiB/s wr, 3 op/s 2024-02-17T23:20:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:31 smithi080 bash[35203]: cluster 2024-02-17T23:20:30.703940+0000 mon.a (mon.0) 592 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2024-02-17T23:20:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:31 smithi080 bash[35203]: audit 2024-02-17T23:20:30.704655+0000 mon.c (mon.1) 21 : audit [INF] from='client.? 172.21.15.5:0/546734377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-17T23:20:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:31 smithi080 bash[35203]: audit 2024-02-17T23:20:30.705304+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-02-17T23:20:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:32 smithi005 bash[35193]: audit 2024-02-17T23:20:31.706578+0000 mon.a (mon.0) 594 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-17T23:20:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:32 smithi005 bash[35193]: cluster 2024-02-17T23:20:31.706712+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-17T23:20:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:32 smithi005 bash[38535]: audit 2024-02-17T23:20:31.706578+0000 mon.a (mon.0) 594 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-17T23:20:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:32 smithi005 bash[38535]: cluster 2024-02-17T23:20:31.706712+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-17T23:20:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:32 smithi080 bash[35203]: audit 2024-02-17T23:20:31.706578+0000 mon.a (mon.0) 594 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-02-17T23:20:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:32 smithi080 bash[35203]: cluster 2024-02-17T23:20:31.706712+0000 mon.a (mon.0) 595 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2024-02-17T23:20:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:33 smithi005 bash[35193]: cluster 2024-02-17T23:20:31.994482+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v229: 65 pgs: 10 creating+peering, 20 unknown, 35 active+clean; 1.8 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 895 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-17T23:20:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:33 smithi005 bash[35193]: cluster 2024-02-17T23:20:32.721626+0000 mon.a (mon.0) 596 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-17T23:20:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:33 smithi005 bash[35193]: audit 2024-02-17T23:20:32.730425+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.15.5:0/546734377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-17T23:20:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:33 smithi005 bash[35193]: audit 2024-02-17T23:20:32.730731+0000 mon.a (mon.0) 597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-17T23:20:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:33 smithi005 bash[38535]: cluster 2024-02-17T23:20:31.994482+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v229: 65 pgs: 10 creating+peering, 20 unknown, 35 active+clean; 1.8 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 895 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-17T23:20:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:33 smithi005 bash[38535]: cluster 2024-02-17T23:20:32.721626+0000 mon.a (mon.0) 596 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-17T23:20:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:33 smithi005 bash[38535]: audit 2024-02-17T23:20:32.730425+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.15.5:0/546734377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-17T23:20:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:33 smithi005 bash[38535]: audit 2024-02-17T23:20:32.730731+0000 mon.a (mon.0) 597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-17T23:20:34.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:33 smithi080 bash[35203]: cluster 2024-02-17T23:20:31.994482+0000 mgr.y (mgr.14140) 235 : cluster [DBG] pgmap v229: 65 pgs: 10 creating+peering, 20 unknown, 35 active+clean; 1.8 KiB data, 4.3 MiB used, 707 GiB / 715 GiB avail; 895 B/s rd, 1.5 KiB/s wr, 2 op/s 2024-02-17T23:20:34.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:33 smithi080 bash[35203]: cluster 2024-02-17T23:20:32.721626+0000 mon.a (mon.0) 596 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2024-02-17T23:20:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:33 smithi080 bash[35203]: audit 2024-02-17T23:20:32.730425+0000 mon.c (mon.1) 22 : audit [INF] from='client.? 172.21.15.5:0/546734377' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-17T23:20:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:33 smithi080 bash[35203]: audit 2024-02-17T23:20:32.730731+0000 mon.a (mon.0) 597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-02-17T23:20:35.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:34 smithi005 bash[35193]: audit 2024-02-17T23:20:33.723503+0000 mon.a (mon.0) 598 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-17T23:20:35.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:34 smithi005 bash[35193]: cluster 2024-02-17T23:20:33.723559+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-17T23:20:35.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:34 smithi005 bash[38535]: audit 2024-02-17T23:20:33.723503+0000 mon.a (mon.0) 598 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-17T23:20:35.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:34 smithi005 bash[38535]: cluster 2024-02-17T23:20:33.723559+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-17T23:20:35.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:34 smithi080 bash[35203]: audit 2024-02-17T23:20:33.723503+0000 mon.a (mon.0) 598 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-02-17T23:20:35.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:34 smithi080 bash[35203]: cluster 2024-02-17T23:20:33.723559+0000 mon.a (mon.0) 599 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2024-02-17T23:20:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:35 smithi005 bash[35193]: cluster 2024-02-17T23:20:33.995124+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v232: 97 pgs: 10 creating+peering, 34 unknown, 53 active+clean; 1.8 KiB data, 4.5 MiB used, 707 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-17T23:20:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:35 smithi005 bash[35193]: cluster 2024-02-17T23:20:34.739620+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-17T23:20:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:35 smithi005 bash[35193]: audit 2024-02-17T23:20:34.743527+0000 mon.a (mon.0) 601 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-17T23:20:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:35 smithi005 bash[38535]: cluster 2024-02-17T23:20:33.995124+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v232: 97 pgs: 10 creating+peering, 34 unknown, 53 active+clean; 1.8 KiB data, 4.5 MiB used, 707 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-17T23:20:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:35 smithi005 bash[38535]: cluster 2024-02-17T23:20:34.739620+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-17T23:20:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:35 smithi005 bash[38535]: audit 2024-02-17T23:20:34.743527+0000 mon.a (mon.0) 601 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-17T23:20:36.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:35 smithi080 bash[35203]: cluster 2024-02-17T23:20:33.995124+0000 mgr.y (mgr.14140) 236 : cluster [DBG] pgmap v232: 97 pgs: 10 creating+peering, 34 unknown, 53 active+clean; 1.8 KiB data, 4.5 MiB used, 707 GiB / 715 GiB avail; 2.0 KiB/s rd, 1 op/s 2024-02-17T23:20:36.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:35 smithi080 bash[35203]: cluster 2024-02-17T23:20:34.739620+0000 mon.a (mon.0) 600 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2024-02-17T23:20:36.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:35 smithi080 bash[35203]: audit 2024-02-17T23:20:34.743527+0000 mon.a (mon.0) 601 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-02-17T23:20:37.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:36 smithi005 bash[35193]: audit 2024-02-17T23:20:35.747230+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-17T23:20:37.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:36 smithi005 bash[35193]: cluster 2024-02-17T23:20:35.747351+0000 mon.a (mon.0) 603 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-17T23:20:37.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:36 smithi005 bash[35193]: audit 2024-02-17T23:20:35.756524+0000 mon.a (mon.0) 604 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-17T23:20:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:36 smithi005 bash[38535]: audit 2024-02-17T23:20:35.747230+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-17T23:20:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:36 smithi005 bash[38535]: cluster 2024-02-17T23:20:35.747351+0000 mon.a (mon.0) 603 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-17T23:20:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:36 smithi005 bash[38535]: audit 2024-02-17T23:20:35.756524+0000 mon.a (mon.0) 604 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-17T23:20:37.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:36 smithi080 bash[35203]: audit 2024-02-17T23:20:35.747230+0000 mon.a (mon.0) 602 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-02-17T23:20:37.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:36 smithi080 bash[35203]: cluster 2024-02-17T23:20:35.747351+0000 mon.a (mon.0) 603 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2024-02-17T23:20:37.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:36 smithi080 bash[35203]: audit 2024-02-17T23:20:35.756524+0000 mon.a (mon.0) 604 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "id": "4b703169-6ba6-47b4-abd3-59d5efbf481b", 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "epoch": 1, 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "predecessor_uuid": "530caed9-e29b-458a-9c80-3b5ffc52bb03", 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_status": [], 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "period_map": { 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "id": "4b703169-6ba6-47b4-abd3-59d5efbf481b", 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "zonegroups": [ 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "id": "ac5cf3db-de60-4cc8-b03d-7f8a1402acbb", 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default", 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "api_name": "default", 2024-02-17T23:20:37.847 INFO:teuthology.orchestra.run.smithi005.stdout: "is_master": "true", 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "endpoints": [], 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "hostnames": [], 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "hostnames_s3website": [], 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "master_zone": "82d65cbe-669b-45b0-a956-08f3b8cf6474", 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "zones": [ 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "id": "82d65cbe-669b-45b0-a956-08f3b8cf6474", 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "z", 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "endpoints": [], 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "log_meta": "false", 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "log_data": "false", 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "bucket_index_max_shards": 11, 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "read_only": "false", 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "tier_type": "", 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_from_all": "true", 2024-02-17T23:20:37.848 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_from": [], 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: "redirect_zone": "" 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: "placement_targets": [ 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: "name": "default-placement", 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: "tags": [], 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: "storage_classes": [ 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: "STANDARD" 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: "default_placement": "default-placement", 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: "realm_id": "13bbdd3f-89fb-451e-9897-8b7e9e59c026", 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: "sync_policy": { 2024-02-17T23:20:37.849 INFO:teuthology.orchestra.run.smithi005.stdout: "groups": [] 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: "short_zone_ids": [ 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: { 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: "key": "82d65cbe-669b-45b0-a956-08f3b8cf6474", 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: "val": 943191306 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: "master_zonegroup": "ac5cf3db-de60-4cc8-b03d-7f8a1402acbb", 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: "master_zone": "82d65cbe-669b-45b0-a956-08f3b8cf6474", 2024-02-17T23:20:37.850 INFO:teuthology.orchestra.run.smithi005.stdout: "period_config": { 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "bucket_quota": { 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "user_quota": { 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "enabled": false, 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "check_on_raw": false, 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size": -1, 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max_size_kb": 0, 2024-02-17T23:20:37.851 INFO:teuthology.orchestra.run.smithi005.stdout: "max_objects": -1 2024-02-17T23:20:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:20:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:20:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "realm_id": "13bbdd3f-89fb-451e-9897-8b7e9e59c026", 2024-02-17T23:20:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "realm_name": "r", 2024-02-17T23:20:37.852 INFO:teuthology.orchestra.run.smithi005.stdout: "realm_epoch": 2 2024-02-17T23:20:37.852 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:20:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:37 smithi005 bash[35193]: cluster 2024-02-17T23:20:35.995533+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v235: 129 pgs: 1 creating+activating, 8 creating+peering, 43 unknown, 77 active+clean; 1.8 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-02-17T23:20:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:37 smithi005 bash[35193]: audit 2024-02-17T23:20:36.753588+0000 mon.a (mon.0) 605 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-17T23:20:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:37 smithi005 bash[35193]: cluster 2024-02-17T23:20:36.753646+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-17T23:20:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:37 smithi005 bash[35193]: audit 2024-02-17T23:20:36.755245+0000 mon.a (mon.0) 607 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-17T23:20:38.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:37 smithi005 bash[38535]: cluster 2024-02-17T23:20:35.995533+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v235: 129 pgs: 1 creating+activating, 8 creating+peering, 43 unknown, 77 active+clean; 1.8 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-02-17T23:20:38.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:37 smithi005 bash[38535]: audit 2024-02-17T23:20:36.753588+0000 mon.a (mon.0) 605 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-17T23:20:38.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:37 smithi005 bash[38535]: cluster 2024-02-17T23:20:36.753646+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-17T23:20:38.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:37 smithi005 bash[38535]: audit 2024-02-17T23:20:36.755245+0000 mon.a (mon.0) 607 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-17T23:20:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:37 smithi080 bash[35203]: cluster 2024-02-17T23:20:35.995533+0000 mgr.y (mgr.14140) 237 : cluster [DBG] pgmap v235: 129 pgs: 1 creating+activating, 8 creating+peering, 43 unknown, 77 active+clean; 1.8 KiB data, 4.6 MiB used, 707 GiB / 715 GiB avail; 3.7 KiB/s rd, 3 op/s 2024-02-17T23:20:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:37 smithi080 bash[35203]: audit 2024-02-17T23:20:36.753588+0000 mon.a (mon.0) 605 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-02-17T23:20:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:37 smithi080 bash[35203]: cluster 2024-02-17T23:20:36.753646+0000 mon.a (mon.0) 606 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2024-02-17T23:20:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:37 smithi080 bash[35203]: audit 2024-02-17T23:20:36.755245+0000 mon.a (mon.0) 607 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-02-17T23:20:38.630 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph orch apply rgw r z --placement=2 --port=8000' 2024-02-17T23:20:38.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:38 smithi005 bash[38535]: audit 2024-02-17T23:20:37.754875+0000 mon.a (mon.0) 608 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-17T23:20:38.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:38 smithi005 bash[38535]: cluster 2024-02-17T23:20:37.754930+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-17T23:20:38.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:38 smithi005 bash[35193]: audit 2024-02-17T23:20:37.754875+0000 mon.a (mon.0) 608 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-17T23:20:38.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:38 smithi005 bash[35193]: cluster 2024-02-17T23:20:37.754930+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-17T23:20:39.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:38 smithi080 bash[35203]: audit 2024-02-17T23:20:37.754875+0000 mon.a (mon.0) 608 : audit [INF] from='client.? 172.21.15.5:0/291893562' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-02-17T23:20:39.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:38 smithi080 bash[35203]: cluster 2024-02-17T23:20:37.754930+0000 mon.a (mon.0) 609 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2024-02-17T23:20:39.940 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:39 smithi005 bash[35193]: cluster 2024-02-17T23:20:37.996093+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v238: 129 pgs: 1 creating+activating, 4 creating+peering, 9 unknown, 115 active+clean; 1.8 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-02-17T23:20:39.941 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:39 smithi005 bash[38535]: cluster 2024-02-17T23:20:37.996093+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v238: 129 pgs: 1 creating+activating, 4 creating+peering, 9 unknown, 115 active+clean; 1.8 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-02-17T23:20:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:39 smithi080 bash[35203]: cluster 2024-02-17T23:20:37.996093+0000 mgr.y (mgr.14140) 238 : cluster [DBG] pgmap v238: 129 pgs: 1 creating+activating, 4 creating+peering, 9 unknown, 115 active+clean; 1.8 KiB data, 4.8 MiB used, 707 GiB / 715 GiB avail; 2.5 KiB/s rd, 2 op/s 2024-02-17T23:20:40.675 INFO:teuthology.orchestra.run.smithi005.stdout:Scheduled rgw update... 2024-02-17T23:20:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.668506+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-17T23:20:40.668225\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-02-17T23:20:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.671002+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-17T23:20:40.668225\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-02-17T23:20:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.672764+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-02-17T23:20:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.676393+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-02-17T23:20:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.677197+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-02-17T23:20:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.681756+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-02-17T23:20:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.682578+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-02-17T23:20:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.687257+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-02-17T23:20:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.688085+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-17T23:20:41.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.690791+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.691420+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[35193]: audit 2024-02-17T23:20:40.692156+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi080.qdwuig", "key": "container_image"}]: dispatch 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.668506+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-17T23:20:40.668225\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.671002+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-17T23:20:40.668225\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.672764+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.676393+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.677197+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.681756+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.682578+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.687257+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.688085+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-17T23:20:41.083 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.690791+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-17T23:20:41.084 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.691420+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:20:41.084 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:40 smithi005 bash[38535]: audit 2024-02-17T23:20:40.692156+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi080.qdwuig", "key": "container_image"}]: dispatch 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.668506+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-17T23:20:40.668225\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]: dispatch 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.671002+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/spec.rgw.r.z","val":"{\"created\": \"2024-02-17T23:20:40.668225\", \"spec\": {\"placement\": {\"count\": 2}, \"rgw_frontend_port\": 8000, \"rgw_realm\": \"r\", \"rgw_zone\": \"z\", \"service_id\": \"r.z\", \"service_type\": \"rgw\"}}"}]': finished 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.672764+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]: dispatch 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.676393+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_zone", "value": "z"}]': finished 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.677197+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]: dispatch 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.681756+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r", "name": "rgw_realm", "value": "r"}]': finished 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.682578+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]: dispatch 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.687257+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "who": "client.rgw.r.z", "name": "rgw_frontends", "value": "beast port=8000"}]': finished 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.688085+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.690791+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.691420+0000 mon.a (mon.0) 620 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:20:41.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:40 smithi080 bash[35203]: audit 2024-02-17T23:20:40.692156+0000 mon.a (mon.0) 621 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi080.qdwuig", "key": "container_image"}]: dispatch 2024-02-17T23:20:41.453 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'sleep 120' 2024-02-17T23:20:42.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:41 smithi005 bash[35193]: cluster 2024-02-17T23:20:39.996696+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v239: 129 pgs: 1 creating+activating, 128 active+clean; 4.8 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 2.9 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-02-17T23:20:42.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:41 smithi005 bash[35193]: audit 2024-02-17T23:20:40.667709+0000 mgr.y (mgr.14140) 240 : audit [DBG] from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:20:42.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:41 smithi005 bash[35193]: cephadm 2024-02-17T23:20:40.668213+0000 mgr.y (mgr.14140) 241 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-17T23:20:42.122 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:41 smithi005 bash[35193]: cephadm 2024-02-17T23:20:40.691829+0000 mgr.y (mgr.14140) 242 : cephadm [INF] Deploying daemon rgw.r.z.smithi080.qdwuig on smithi080 2024-02-17T23:20:42.122 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:41 smithi005 bash[38535]: cluster 2024-02-17T23:20:39.996696+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v239: 129 pgs: 1 creating+activating, 128 active+clean; 4.8 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 2.9 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-02-17T23:20:42.122 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:41 smithi005 bash[38535]: audit 2024-02-17T23:20:40.667709+0000 mgr.y (mgr.14140) 240 : audit [DBG] from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:20:42.122 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:41 smithi005 bash[38535]: cephadm 2024-02-17T23:20:40.668213+0000 mgr.y (mgr.14140) 241 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-17T23:20:42.122 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:41 smithi005 bash[38535]: cephadm 2024-02-17T23:20:40.691829+0000 mgr.y (mgr.14140) 242 : cephadm [INF] Deploying daemon rgw.r.z.smithi080.qdwuig on smithi080 2024-02-17T23:20:42.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:41 smithi080 bash[35203]: cluster 2024-02-17T23:20:39.996696+0000 mgr.y (mgr.14140) 239 : cluster [DBG] pgmap v239: 129 pgs: 1 creating+activating, 128 active+clean; 4.8 KiB data, 5.1 MiB used, 707 GiB / 715 GiB avail; 2.9 KiB/s rd, 3.2 KiB/s wr, 13 op/s 2024-02-17T23:20:42.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:41 smithi080 bash[35203]: audit 2024-02-17T23:20:40.667709+0000 mgr.y (mgr.14140) 240 : audit [DBG] from='client.24535 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "r", "zone_name": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:20:42.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:41 smithi080 bash[35203]: cephadm 2024-02-17T23:20:40.668213+0000 mgr.y (mgr.14140) 241 : cephadm [INF] Saving service rgw.r.z spec with placement count:2 2024-02-17T23:20:42.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:41 smithi080 bash[35203]: cephadm 2024-02-17T23:20:40.691829+0000 mgr.y (mgr.14140) 242 : cephadm [INF] Deploying daemon rgw.r.z.smithi080.qdwuig on smithi080 2024-02-17T23:20:43.049 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[35193]: audit 2024-02-17T23:20:42.517225+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:43.050 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[35193]: audit 2024-02-17T23:20:42.520052+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:43.050 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[35193]: audit 2024-02-17T23:20:42.520652+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-17T23:20:43.050 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[35193]: audit 2024-02-17T23:20:42.523919+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-17T23:20:43.050 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[35193]: audit 2024-02-17T23:20:42.524649+0000 mon.a (mon.0) 626 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:20:43.050 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[35193]: audit 2024-02-17T23:20:42.525470+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi005.dlhvju", "key": "container_image"}]: dispatch 2024-02-17T23:20:43.050 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[38535]: audit 2024-02-17T23:20:42.517225+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:43.051 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[38535]: audit 2024-02-17T23:20:42.520052+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:43.051 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[38535]: audit 2024-02-17T23:20:42.520652+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-17T23:20:43.051 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[38535]: audit 2024-02-17T23:20:42.523919+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-17T23:20:43.051 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[38535]: audit 2024-02-17T23:20:42.524649+0000 mon.a (mon.0) 626 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:20:43.051 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:42 smithi005 bash[38535]: audit 2024-02-17T23:20:42.525470+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi005.dlhvju", "key": "container_image"}]: dispatch 2024-02-17T23:20:43.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:42 smithi080 bash[35203]: audit 2024-02-17T23:20:42.517225+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:43.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:42 smithi080 bash[35203]: audit 2024-02-17T23:20:42.520052+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995403\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995481\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995515\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995547\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995577\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995607\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995636\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995666\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:18.995695\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:43.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:42 smithi080 bash[35203]: audit 2024-02-17T23:20:42.520652+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]: dispatch 2024-02-17T23:20:43.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:42 smithi080 bash[35203]: audit 2024-02-17T23:20:42.523919+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow rw", "mgr", "allow rw", "osd", "allow rwx"]}]': finished 2024-02-17T23:20:43.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:42 smithi080 bash[35203]: audit 2024-02-17T23:20:42.524649+0000 mon.a (mon.0) 626 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:20:43.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:42 smithi080 bash[35203]: audit 2024-02-17T23:20:42.525470+0000 mon.a (mon.0) 627 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.r.z.smithi005.dlhvju", "key": "container_image"}]: dispatch 2024-02-17T23:20:44.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:43 smithi005 bash[35193]: cluster 2024-02-17T23:20:41.997410+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 6.2 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 982 B/s rd, 5.0 KiB/s wr, 18 op/s 2024-02-17T23:20:44.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:43 smithi005 bash[35193]: cephadm 2024-02-17T23:20:42.525120+0000 mgr.y (mgr.14140) 244 : cephadm [INF] Deploying daemon rgw.r.z.smithi005.dlhvju on smithi005 2024-02-17T23:20:44.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:43 smithi005 bash[38535]: cluster 2024-02-17T23:20:41.997410+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 6.2 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 982 B/s rd, 5.0 KiB/s wr, 18 op/s 2024-02-17T23:20:44.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:43 smithi005 bash[38535]: cephadm 2024-02-17T23:20:42.525120+0000 mgr.y (mgr.14140) 244 : cephadm [INF] Deploying daemon rgw.r.z.smithi005.dlhvju on smithi005 2024-02-17T23:20:44.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:43 smithi080 bash[35203]: cluster 2024-02-17T23:20:41.997410+0000 mgr.y (mgr.14140) 243 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 6.2 KiB data, 5.4 MiB used, 707 GiB / 715 GiB avail; 982 B/s rd, 5.0 KiB/s wr, 18 op/s 2024-02-17T23:20:44.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:43 smithi080 bash[35203]: cephadm 2024-02-17T23:20:42.525120+0000 mgr.y (mgr.14140) 244 : cephadm [INF] Deploying daemon rgw.r.z.smithi005.dlhvju on smithi005 2024-02-17T23:20:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:45 smithi005 bash[35193]: cluster 2024-02-17T23:20:43.998045+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 6.9 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 4.9 KiB/s wr, 42 op/s 2024-02-17T23:20:46.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:45 smithi005 bash[38535]: cluster 2024-02-17T23:20:43.998045+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 6.9 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 4.9 KiB/s wr, 42 op/s 2024-02-17T23:20:46.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:45 smithi005 bash[35193]: audit 2024-02-17T23:20:45.082183+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:46.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:45 smithi005 bash[35193]: audit 2024-02-17T23:20:45.085403+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:46.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:45 smithi005 bash[35193]: audit 2024-02-17T23:20:45.086057+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:46.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:45 smithi005 bash[38535]: audit 2024-02-17T23:20:45.082183+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:46.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:45 smithi005 bash[38535]: audit 2024-02-17T23:20:45.085403+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:46.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:45 smithi005 bash[38535]: audit 2024-02-17T23:20:45.086057+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:45 smithi080 bash[35203]: cluster 2024-02-17T23:20:43.998045+0000 mgr.y (mgr.14140) 245 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 6.9 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 12 KiB/s rd, 4.9 KiB/s wr, 42 op/s 2024-02-17T23:20:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:45 smithi080 bash[35203]: audit 2024-02-17T23:20:45.082183+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:45 smithi080 bash[35203]: audit 2024-02-17T23:20:45.085403+0000 mon.a (mon.0) 629 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.438990\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439070\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439124\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439157\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439188\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439219\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439250\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439281\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:15.439312\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"status\": 1, \"status_desc\": \"starting\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:45 smithi080 bash[35203]: audit 2024-02-17T23:20:45.086057+0000 mon.a (mon.0) 630 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:47 smithi005 bash[35193]: cluster 2024-02-17T23:20:45.998459+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 4.3 KiB/s wr, 71 op/s 2024-02-17T23:20:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:47 smithi005 bash[38535]: cluster 2024-02-17T23:20:45.998459+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 4.3 KiB/s wr, 71 op/s 2024-02-17T23:20:48.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:47 smithi080 bash[35203]: cluster 2024-02-17T23:20:45.998459+0000 mgr.y (mgr.14140) 246 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 27 KiB/s rd, 4.3 KiB/s wr, 71 op/s 2024-02-17T23:20:49.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:49 smithi080 bash[35203]: cluster 2024-02-17T23:20:47.999004+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 76 KiB/s rd, 3.9 KiB/s wr, 158 op/s 2024-02-17T23:20:49.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:49 smithi080 bash[35203]: audit 2024-02-17T23:20:48.768148+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766808\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766893\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766928\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766959\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766988\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767018\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767048\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767087\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767123\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767153\", \"created\": \"2024-02-17T23:20:45.051564\", \"started\": \"2024-02-17T23:20:45.083187\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_daemon_update\": \"2024-02-17T23:20:48.767236\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:49.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:49 smithi080 bash[35203]: audit 2024-02-17T23:20:48.771178+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766808\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766893\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766928\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766959\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766988\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767018\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767048\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767087\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767123\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767153\", \"created\": \"2024-02-17T23:20:45.051564\", \"started\": \"2024-02-17T23:20:45.083187\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_daemon_update\": \"2024-02-17T23:20:48.767236\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:49.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:49 smithi080 bash[35203]: audit 2024-02-17T23:20:48.771779+0000 mon.a (mon.0) 633 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:49 smithi005 bash[35193]: cluster 2024-02-17T23:20:47.999004+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 76 KiB/s rd, 3.9 KiB/s wr, 158 op/s 2024-02-17T23:20:50.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:49 smithi005 bash[38535]: cluster 2024-02-17T23:20:47.999004+0000 mgr.y (mgr.14140) 247 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 76 KiB/s rd, 3.9 KiB/s wr, 158 op/s 2024-02-17T23:20:50.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:49 smithi005 bash[35193]: audit 2024-02-17T23:20:48.768148+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766808\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766893\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766928\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766959\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766988\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767018\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767048\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767087\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767123\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767153\", \"created\": \"2024-02-17T23:20:45.051564\", \"started\": \"2024-02-17T23:20:45.083187\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_daemon_update\": \"2024-02-17T23:20:48.767236\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:50.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:49 smithi005 bash[35193]: audit 2024-02-17T23:20:48.771178+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766808\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766893\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766928\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766959\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766988\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767018\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767048\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767087\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767123\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767153\", \"created\": \"2024-02-17T23:20:45.051564\", \"started\": \"2024-02-17T23:20:45.083187\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_daemon_update\": \"2024-02-17T23:20:48.767236\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:50.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:49 smithi005 bash[35193]: audit 2024-02-17T23:20:48.771779+0000 mon.a (mon.0) 633 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:50.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:49 smithi005 bash[38535]: audit 2024-02-17T23:20:48.768148+0000 mon.a (mon.0) 631 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766808\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766893\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766928\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766959\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766988\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767018\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767048\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767087\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767123\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767153\", \"created\": \"2024-02-17T23:20:45.051564\", \"started\": \"2024-02-17T23:20:45.083187\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_daemon_update\": \"2024-02-17T23:20:48.767236\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]: dispatch 2024-02-17T23:20:50.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:49 smithi005 bash[38535]: audit 2024-02-17T23:20:48.771178+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"a\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766808\", \"created\": \"2024-02-17T23:13:42.568170\", \"started\": \"2024-02-17T23:13:48.028988\"}, \"mgr.y\": {\"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"y\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766893\", \"created\": \"2024-02-17T23:13:49.724025\", \"started\": \"2024-02-17T23:13:49.754962\"}, \"mon.c\": {\"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"c\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766928\", \"created\": \"2024-02-17T23:15:06.215469\", \"started\": \"2024-02-17T23:15:06.248890\"}, \"osd.0\": {\"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"0\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766959\", \"created\": \"2024-02-17T23:16:01.235348\", \"started\": \"2024-02-17T23:16:03.415063\"}, \"osd.1\": {\"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"1\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.766988\", \"created\": \"2024-02-17T23:16:21.463936\", \"started\": \"2024-02-17T23:16:23.451785\"}, \"osd.2\": {\"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"2\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767018\", \"created\": \"2024-02-17T23:16:41.581525\", \"started\": \"2024-02-17T23:16:43.921834\"}, \"osd.3\": {\"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"3\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767048\", \"created\": \"2024-02-17T23:17:03.071087\", \"started\": \"2024-02-17T23:17:05.653800\"}, \"node-exporter.a\": {\"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767087\", \"created\": \"2024-02-17T23:18:55.715789\", \"started\": \"2024-02-17T23:19:07.859907\"}, \"alertmanager.a\": {\"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"alertmanager\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767123\", \"created\": \"2024-02-17T23:19:16.461367\", \"started\": \"2024-02-17T23:19:52.239853\"}, \"rgw.r.z.smithi005.dlhvju\": {\"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:48.767153\", \"created\": \"2024-02-17T23:20:45.051564\", \"started\": \"2024-02-17T23:20:45.083187\"}}, \"devices\": [{\"rejected_reasons\": [\"locked\", \"LVM detected\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\"}], \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420\"}}, \"last_daemon_update\": \"2024-02-17T23:20:48.767236\", \"last_device_update\": \"2024-02-17T23:17:10.056653\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.5\"]}, \"last_host_check\": \"2024-02-17T23:14:16.827691\"}"}]': finished 2024-02-17T23:20:50.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:49 smithi005 bash[38535]: audit 2024-02-17T23:20:48.771779+0000 mon.a (mon.0) 633 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:20:52.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:51 smithi005 bash[35193]: cluster 2024-02-17T23:20:49.999563+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 3.4 KiB/s wr, 164 op/s 2024-02-17T23:20:52.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:51 smithi005 bash[38535]: cluster 2024-02-17T23:20:49.999563+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 3.4 KiB/s wr, 164 op/s 2024-02-17T23:20:52.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:51 smithi080 bash[35203]: cluster 2024-02-17T23:20:49.999563+0000 mgr.y (mgr.14140) 248 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 3.4 KiB/s wr, 164 op/s 2024-02-17T23:20:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:53 smithi005 bash[35193]: cluster 2024-02-17T23:20:52.000085+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 2.0 KiB/s wr, 173 op/s 2024-02-17T23:20:54.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:53 smithi005 bash[38535]: cluster 2024-02-17T23:20:52.000085+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 2.0 KiB/s wr, 173 op/s 2024-02-17T23:20:54.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:53 smithi005 bash[38535]: audit 2024-02-17T23:20:52.799454+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798143\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:20:52.798531\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:54.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:53 smithi005 bash[38535]: audit 2024-02-17T23:20:52.803573+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798143\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:20:52.798531\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:54.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:53 smithi005 bash[35193]: audit 2024-02-17T23:20:52.799454+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798143\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:20:52.798531\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:54.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:53 smithi005 bash[35193]: audit 2024-02-17T23:20:52.803573+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798143\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:20:52.798531\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:53 smithi080 bash[35203]: cluster 2024-02-17T23:20:52.000085+0000 mgr.y (mgr.14140) 249 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 2.0 KiB/s wr, 173 op/s 2024-02-17T23:20:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:53 smithi080 bash[35203]: audit 2024-02-17T23:20:52.799454+0000 mon.a (mon.0) 634 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798143\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:20:52.798531\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:20:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:53 smithi080 bash[35203]: audit 2024-02-17T23:20:52.803573+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"a5b65c6a5a44\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798143\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:15:43.174613\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:41.245421\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:20:52.798531\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:20:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:55 smithi005 bash[35193]: cluster 2024-02-17T23:20:54.000626+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 853 B/s wr, 169 op/s 2024-02-17T23:20:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:55 smithi005 bash[38535]: cluster 2024-02-17T23:20:54.000626+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 853 B/s wr, 169 op/s 2024-02-17T23:20:56.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:55 smithi080 bash[35203]: cluster 2024-02-17T23:20:54.000626+0000 mgr.y (mgr.14140) 250 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 93 KiB/s rd, 853 B/s wr, 169 op/s 2024-02-17T23:20:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:57 smithi005 bash[35193]: cluster 2024-02-17T23:20:56.001140+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 170 B/s wr, 150 op/s 2024-02-17T23:20:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:57 smithi005 bash[38535]: cluster 2024-02-17T23:20:56.001140+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 170 B/s wr, 150 op/s 2024-02-17T23:20:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:57 smithi080 bash[35203]: cluster 2024-02-17T23:20:56.001140+0000 mgr.y (mgr.14140) 251 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 85 KiB/s rd, 170 B/s wr, 150 op/s 2024-02-17T23:21:00.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:20:59 smithi005 bash[35193]: cluster 2024-02-17T23:20:58.001823+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 72 KiB/s rd, 85 B/s wr, 123 op/s 2024-02-17T23:21:00.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:20:59 smithi005 bash[38535]: cluster 2024-02-17T23:20:58.001823+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 72 KiB/s rd, 85 B/s wr, 123 op/s 2024-02-17T23:21:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:20:59 smithi080 bash[35203]: cluster 2024-02-17T23:20:58.001823+0000 mgr.y (mgr.14140) 252 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 72 KiB/s rd, 85 B/s wr, 123 op/s 2024-02-17T23:21:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:01 smithi005 bash[35193]: cluster 2024-02-17T23:21:00.002530+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 28 KiB/s rd, 85 B/s wr, 43 op/s 2024-02-17T23:21:02.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:01 smithi005 bash[38535]: cluster 2024-02-17T23:21:00.002530+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 28 KiB/s rd, 85 B/s wr, 43 op/s 2024-02-17T23:21:02.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:01 smithi080 bash[35203]: cluster 2024-02-17T23:21:00.002530+0000 mgr.y (mgr.14140) 253 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 28 KiB/s rd, 85 B/s wr, 43 op/s 2024-02-17T23:21:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:03 smithi005 bash[35193]: cluster 2024-02-17T23:21:02.003056+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 9.0 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-17T23:21:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:03 smithi005 bash[38535]: cluster 2024-02-17T23:21:02.003056+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 9.0 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-17T23:21:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:03 smithi080 bash[35203]: cluster 2024-02-17T23:21:02.003056+0000 mgr.y (mgr.14140) 254 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail; 9.0 KiB/s rd, 0 B/s wr, 13 op/s 2024-02-17T23:21:06.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:05 smithi005 bash[35193]: cluster 2024-02-17T23:21:04.003723+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:06.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:05 smithi005 bash[38535]: cluster 2024-02-17T23:21:04.003723+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:06.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:05 smithi080 bash[35203]: cluster 2024-02-17T23:21:04.003723+0000 mgr.y (mgr.14140) 255 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:08.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:07 smithi005 bash[35193]: cluster 2024-02-17T23:21:06.004369+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:08.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:07 smithi005 bash[38535]: cluster 2024-02-17T23:21:06.004369+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:08.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:07 smithi080 bash[35203]: cluster 2024-02-17T23:21:06.004369+0000 mgr.y (mgr.14140) 256 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:09 smithi005 bash[35193]: cluster 2024-02-17T23:21:08.004902+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:10.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:09 smithi005 bash[38535]: cluster 2024-02-17T23:21:08.004902+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:10.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:09 smithi080 bash[35203]: cluster 2024-02-17T23:21:08.004902+0000 mgr.y (mgr.14140) 257 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:11 smithi005 bash[35193]: cluster 2024-02-17T23:21:10.005355+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:12.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:11 smithi005 bash[38535]: cluster 2024-02-17T23:21:10.005355+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:12.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:11 smithi080 bash[35203]: cluster 2024-02-17T23:21:10.005355+0000 mgr.y (mgr.14140) 258 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:14.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:13 smithi005 bash[38535]: cluster 2024-02-17T23:21:12.006113+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:14.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:13 smithi005 bash[35193]: cluster 2024-02-17T23:21:12.006113+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:14.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:13 smithi080 bash[35203]: cluster 2024-02-17T23:21:12.006113+0000 mgr.y (mgr.14140) 259 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:15 smithi005 bash[35193]: cluster 2024-02-17T23:21:14.006727+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:15 smithi005 bash[38535]: cluster 2024-02-17T23:21:14.006727+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:16.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:15 smithi080 bash[35203]: cluster 2024-02-17T23:21:14.006727+0000 mgr.y (mgr.14140) 260 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:17 smithi005 bash[35193]: cluster 2024-02-17T23:21:16.007385+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:18.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:17 smithi005 bash[38535]: cluster 2024-02-17T23:21:16.007385+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:18.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:17 smithi080 bash[35203]: cluster 2024-02-17T23:21:16.007385+0000 mgr.y (mgr.14140) 261 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:19 smithi005 bash[35193]: cluster 2024-02-17T23:21:18.007914+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:20.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:19 smithi005 bash[38535]: cluster 2024-02-17T23:21:18.007914+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:20.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:19 smithi080 bash[35203]: cluster 2024-02-17T23:21:18.007914+0000 mgr.y (mgr.14140) 262 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:21 smithi005 bash[35193]: cluster 2024-02-17T23:21:20.008624+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:22.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:21 smithi005 bash[38535]: cluster 2024-02-17T23:21:20.008624+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:22.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:21 smithi080 bash[35203]: cluster 2024-02-17T23:21:20.008624+0000 mgr.y (mgr.14140) 263 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:24.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:23 smithi005 bash[35193]: cluster 2024-02-17T23:21:22.009202+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:24.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:23 smithi005 bash[38535]: cluster 2024-02-17T23:21:22.009202+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:24.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:23 smithi080 bash[35203]: cluster 2024-02-17T23:21:22.009202+0000 mgr.y (mgr.14140) 264 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:25 smithi005 bash[35193]: cluster 2024-02-17T23:21:24.009877+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:26.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:25 smithi005 bash[38535]: cluster 2024-02-17T23:21:24.009877+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:26.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:25 smithi080 bash[35203]: cluster 2024-02-17T23:21:24.009877+0000 mgr.y (mgr.14140) 265 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:27 smithi005 bash[35193]: cluster 2024-02-17T23:21:26.010500+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:28.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:27 smithi005 bash[38535]: cluster 2024-02-17T23:21:26.010500+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:27 smithi080 bash[35203]: cluster 2024-02-17T23:21:26.010500+0000 mgr.y (mgr.14140) 266 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:29 smithi005 bash[35193]: cluster 2024-02-17T23:21:28.011030+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:30.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:29 smithi005 bash[38535]: cluster 2024-02-17T23:21:28.011030+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:30.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:29 smithi080 bash[35203]: cluster 2024-02-17T23:21:28.011030+0000 mgr.y (mgr.14140) 267 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:31 smithi005 bash[35193]: cluster 2024-02-17T23:21:30.011804+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:32.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:31 smithi005 bash[38535]: cluster 2024-02-17T23:21:30.011804+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:32.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:31 smithi080 bash[35203]: cluster 2024-02-17T23:21:30.011804+0000 mgr.y (mgr.14140) 268 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:33 smithi005 bash[35193]: cluster 2024-02-17T23:21:32.012318+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:33 smithi005 bash[38535]: cluster 2024-02-17T23:21:32.012318+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:33 smithi080 bash[35203]: cluster 2024-02-17T23:21:32.012318+0000 mgr.y (mgr.14140) 269 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:35 smithi005 bash[35193]: cluster 2024-02-17T23:21:34.013043+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:35 smithi005 bash[38535]: cluster 2024-02-17T23:21:34.013043+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:36.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:35 smithi080 bash[35203]: cluster 2024-02-17T23:21:34.013043+0000 mgr.y (mgr.14140) 270 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:37 smithi005 bash[35193]: cluster 2024-02-17T23:21:36.013573+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:38.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:37 smithi005 bash[38535]: cluster 2024-02-17T23:21:36.013573+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:37 smithi080 bash[35203]: cluster 2024-02-17T23:21:36.013573+0000 mgr.y (mgr.14140) 271 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:40.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:39 smithi005 bash[35193]: cluster 2024-02-17T23:21:38.014343+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:40.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:39 smithi005 bash[38535]: cluster 2024-02-17T23:21:38.014343+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:40.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:39 smithi080 bash[35203]: cluster 2024-02-17T23:21:38.014343+0000 mgr.y (mgr.14140) 272 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:41 smithi005 bash[35193]: cluster 2024-02-17T23:21:40.015087+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:42.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:41 smithi005 bash[38535]: cluster 2024-02-17T23:21:40.015087+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:42.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:41 smithi080 bash[35203]: cluster 2024-02-17T23:21:40.015087+0000 mgr.y (mgr.14140) 273 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:44.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:43 smithi005 bash[35193]: cluster 2024-02-17T23:21:42.015741+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:44.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:43 smithi005 bash[38535]: cluster 2024-02-17T23:21:42.015741+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:44.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:43 smithi080 bash[35203]: cluster 2024-02-17T23:21:42.015741+0000 mgr.y (mgr.14140) 274 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:45 smithi005 bash[35193]: cluster 2024-02-17T23:21:44.016302+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:45 smithi005 bash[38535]: cluster 2024-02-17T23:21:44.016302+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:45 smithi080 bash[35203]: cluster 2024-02-17T23:21:44.016302+0000 mgr.y (mgr.14140) 275 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:47 smithi005 bash[35193]: cluster 2024-02-17T23:21:46.016906+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:47 smithi005 bash[38535]: cluster 2024-02-17T23:21:46.016906+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:48.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:47 smithi080 bash[35203]: cluster 2024-02-17T23:21:46.016906+0000 mgr.y (mgr.14140) 276 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:49 smithi005 bash[35193]: cluster 2024-02-17T23:21:48.017523+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:50.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:49 smithi005 bash[38535]: cluster 2024-02-17T23:21:48.017523+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:50.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:49 smithi080 bash[35203]: cluster 2024-02-17T23:21:48.017523+0000 mgr.y (mgr.14140) 277 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:51.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:50 smithi005 bash[35193]: cluster 2024-02-17T23:21:50.018180+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:51.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:50 smithi005 bash[38535]: cluster 2024-02-17T23:21:50.018180+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:51.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:50 smithi080 bash[35203]: cluster 2024-02-17T23:21:50.018180+0000 mgr.y (mgr.14140) 278 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:53.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:53 smithi005 bash[35193]: cluster 2024-02-17T23:21:52.018712+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:53.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:53 smithi005 bash[38535]: cluster 2024-02-17T23:21:52.018712+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:53.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:53 smithi080 bash[35203]: cluster 2024-02-17T23:21:52.018712+0000 mgr.y (mgr.14140) 279 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:55 smithi005 bash[35193]: cluster 2024-02-17T23:21:54.019374+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:55 smithi005 bash[38535]: cluster 2024-02-17T23:21:54.019374+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:56.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:55 smithi080 bash[35203]: cluster 2024-02-17T23:21:54.019374+0000 mgr.y (mgr.14140) 280 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:57 smithi005 bash[35193]: cluster 2024-02-17T23:21:56.020072+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:57 smithi005 bash[38535]: cluster 2024-02-17T23:21:56.020072+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:21:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:57 smithi080 bash[35203]: cluster 2024-02-17T23:21:56.020072+0000 mgr.y (mgr.14140) 281 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:00.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:21:59 smithi005 bash[35193]: cluster 2024-02-17T23:21:58.020682+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:00.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:21:59 smithi005 bash[38535]: cluster 2024-02-17T23:21:58.020682+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:00.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:21:59 smithi080 bash[35203]: cluster 2024-02-17T23:21:58.020682+0000 mgr.y (mgr.14140) 282 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:01 smithi005 bash[35193]: cluster 2024-02-17T23:22:00.021177+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:02.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:01 smithi005 bash[38535]: cluster 2024-02-17T23:22:00.021177+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:02.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:01 smithi080 bash[35203]: cluster 2024-02-17T23:22:00.021177+0000 mgr.y (mgr.14140) 283 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:04.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:03 smithi005 bash[38535]: cluster 2024-02-17T23:22:02.021869+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:03 smithi005 bash[35193]: cluster 2024-02-17T23:22:02.021869+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:03 smithi080 bash[35203]: cluster 2024-02-17T23:22:02.021869+0000 mgr.y (mgr.14140) 284 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:06.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:05 smithi005 bash[35193]: cluster 2024-02-17T23:22:04.022592+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:06.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:05 smithi005 bash[38535]: cluster 2024-02-17T23:22:04.022592+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:06.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:05 smithi080 bash[35203]: cluster 2024-02-17T23:22:04.022592+0000 mgr.y (mgr.14140) 285 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:08.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:07 smithi005 bash[35193]: cluster 2024-02-17T23:22:06.023174+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:08.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:07 smithi005 bash[38535]: cluster 2024-02-17T23:22:06.023174+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:08.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:07 smithi080 bash[35203]: cluster 2024-02-17T23:22:06.023174+0000 mgr.y (mgr.14140) 286 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:09 smithi005 bash[35193]: cluster 2024-02-17T23:22:08.023831+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:10.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:09 smithi005 bash[38535]: cluster 2024-02-17T23:22:08.023831+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:10.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:09 smithi080 bash[35203]: cluster 2024-02-17T23:22:08.023831+0000 mgr.y (mgr.14140) 287 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:11 smithi005 bash[35193]: cluster 2024-02-17T23:22:10.024550+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:12.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:11 smithi005 bash[38535]: cluster 2024-02-17T23:22:10.024550+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:12.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:11 smithi080 bash[35203]: cluster 2024-02-17T23:22:10.024550+0000 mgr.y (mgr.14140) 288 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:14.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:13 smithi005 bash[35193]: cluster 2024-02-17T23:22:12.025089+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:14.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:13 smithi005 bash[38535]: cluster 2024-02-17T23:22:12.025089+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:13 smithi080 bash[35203]: cluster 2024-02-17T23:22:12.025089+0000 mgr.y (mgr.14140) 289 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:15 smithi005 bash[35193]: cluster 2024-02-17T23:22:14.025799+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:15 smithi005 bash[38535]: cluster 2024-02-17T23:22:14.025799+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:16.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:15 smithi080 bash[35203]: cluster 2024-02-17T23:22:14.025799+0000 mgr.y (mgr.14140) 290 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:17 smithi005 bash[35193]: cluster 2024-02-17T23:22:16.026484+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:18.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:17 smithi005 bash[38535]: cluster 2024-02-17T23:22:16.026484+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:18.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:17 smithi080 bash[35203]: cluster 2024-02-17T23:22:16.026484+0000 mgr.y (mgr.14140) 291 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:19 smithi005 bash[35193]: cluster 2024-02-17T23:22:18.027142+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:20.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:19 smithi005 bash[38535]: cluster 2024-02-17T23:22:18.027142+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:20.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:19 smithi080 bash[35203]: cluster 2024-02-17T23:22:18.027142+0000 mgr.y (mgr.14140) 292 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:21 smithi005 bash[35193]: cluster 2024-02-17T23:22:20.027855+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:22.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:21 smithi005 bash[38535]: cluster 2024-02-17T23:22:20.027855+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:22.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:21 smithi080 bash[35203]: cluster 2024-02-17T23:22:20.027855+0000 mgr.y (mgr.14140) 293 : cluster [DBG] pgmap v289: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:24.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:23 smithi005 bash[35193]: cluster 2024-02-17T23:22:22.028455+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:24.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:23 smithi005 bash[38535]: cluster 2024-02-17T23:22:22.028455+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:24.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:23 smithi080 bash[35203]: cluster 2024-02-17T23:22:22.028455+0000 mgr.y (mgr.14140) 294 : cluster [DBG] pgmap v290: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:25 smithi005 bash[35193]: cluster 2024-02-17T23:22:24.029022+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:26.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:25 smithi005 bash[38535]: cluster 2024-02-17T23:22:24.029022+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:26.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:25 smithi080 bash[35203]: cluster 2024-02-17T23:22:24.029022+0000 mgr.y (mgr.14140) 295 : cluster [DBG] pgmap v291: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:27 smithi005 bash[35193]: cluster 2024-02-17T23:22:26.029702+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:28.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:27 smithi005 bash[38535]: cluster 2024-02-17T23:22:26.029702+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:28.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:27 smithi080 bash[35203]: cluster 2024-02-17T23:22:26.029702+0000 mgr.y (mgr.14140) 296 : cluster [DBG] pgmap v292: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:29 smithi005 bash[35193]: cluster 2024-02-17T23:22:28.030327+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:30.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:29 smithi005 bash[38535]: cluster 2024-02-17T23:22:28.030327+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:30.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:29 smithi080 bash[35203]: cluster 2024-02-17T23:22:28.030327+0000 mgr.y (mgr.14140) 297 : cluster [DBG] pgmap v293: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:31 smithi005 bash[35193]: cluster 2024-02-17T23:22:30.030837+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:32.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:31 smithi005 bash[38535]: cluster 2024-02-17T23:22:30.030837+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:32.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:31 smithi080 bash[35203]: cluster 2024-02-17T23:22:30.030837+0000 mgr.y (mgr.14140) 298 : cluster [DBG] pgmap v294: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:33 smithi005 bash[35193]: cluster 2024-02-17T23:22:32.031395+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:33 smithi005 bash[38535]: cluster 2024-02-17T23:22:32.031395+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:34.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:33 smithi080 bash[35203]: cluster 2024-02-17T23:22:32.031395+0000 mgr.y (mgr.14140) 299 : cluster [DBG] pgmap v295: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:35 smithi005 bash[35193]: cluster 2024-02-17T23:22:34.032181+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:35 smithi005 bash[38535]: cluster 2024-02-17T23:22:34.032181+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:36.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:35 smithi080 bash[35203]: cluster 2024-02-17T23:22:34.032181+0000 mgr.y (mgr.14140) 300 : cluster [DBG] pgmap v296: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:37 smithi005 bash[35193]: cluster 2024-02-17T23:22:36.032716+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:38.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:37 smithi005 bash[38535]: cluster 2024-02-17T23:22:36.032716+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:37 smithi080 bash[35203]: cluster 2024-02-17T23:22:36.032716+0000 mgr.y (mgr.14140) 301 : cluster [DBG] pgmap v297: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:40.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:39 smithi005 bash[35193]: cluster 2024-02-17T23:22:38.033444+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:40.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:39 smithi005 bash[38535]: cluster 2024-02-17T23:22:38.033444+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:40.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:39 smithi080 bash[35203]: cluster 2024-02-17T23:22:38.033444+0000 mgr.y (mgr.14140) 302 : cluster [DBG] pgmap v298: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:41 smithi005 bash[35193]: cluster 2024-02-17T23:22:40.033966+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:42.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:41 smithi005 bash[38535]: cluster 2024-02-17T23:22:40.033966+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:42.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:41 smithi080 bash[35203]: cluster 2024-02-17T23:22:40.033966+0000 mgr.y (mgr.14140) 303 : cluster [DBG] pgmap v299: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:44.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:43 smithi005 bash[35193]: cluster 2024-02-17T23:22:42.034714+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:44.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:43 smithi005 bash[38535]: cluster 2024-02-17T23:22:42.034714+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:44.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:43 smithi080 bash[35203]: cluster 2024-02-17T23:22:42.034714+0000 mgr.y (mgr.14140) 304 : cluster [DBG] pgmap v300: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:44.898 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-02-17T23:22:45.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:45 smithi005 bash[35193]: cluster 2024-02-17T23:22:44.035430+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:45.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:45 smithi005 bash[38535]: cluster 2024-02-17T23:22:44.035430+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:45 smithi080 bash[35203]: cluster 2024-02-17T23:22:44.035430+0000 mgr.y (mgr.14140) 305 : cluster [DBG] pgmap v301: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:47.901 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-02-17T23:22:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:47 smithi005 bash[35193]: cluster 2024-02-17T23:22:46.035843+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:47 smithi005 bash[35193]: audit 2024-02-17T23:22:47.209680+0000 mon.a (mon.0) 636 : audit [INF] from='client.? 172.21.15.5:0/2774716087' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-17T23:22:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:47 smithi005 bash[35193]: audit 2024-02-17T23:22:47.213343+0000 mon.a (mon.0) 637 : audit [INF] from='client.? 172.21.15.5:0/2774716087' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-02-17T23:22:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:47 smithi005 bash[38535]: cluster 2024-02-17T23:22:46.035843+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:48.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:47 smithi005 bash[38535]: audit 2024-02-17T23:22:47.209680+0000 mon.a (mon.0) 636 : audit [INF] from='client.? 172.21.15.5:0/2774716087' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-17T23:22:48.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:47 smithi005 bash[38535]: audit 2024-02-17T23:22:47.213343+0000 mon.a (mon.0) 637 : audit [INF] from='client.? 172.21.15.5:0/2774716087' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-02-17T23:22:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:47 smithi080 bash[35203]: cluster 2024-02-17T23:22:46.035843+0000 mgr.y (mgr.14140) 306 : cluster [DBG] pgmap v302: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:47 smithi080 bash[35203]: audit 2024-02-17T23:22:47.209680+0000 mon.a (mon.0) 636 : audit [INF] from='client.? 172.21.15.5:0/2774716087' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]: dispatch 2024-02-17T23:22:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:47 smithi080 bash[35203]: audit 2024-02-17T23:22:47.213343+0000 mon.a (mon.0) 637 : audit [INF] from='client.? 172.21.15.5:0/2774716087' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim", "value": "false", "force": true}]': finished 2024-02-17T23:22:50.086 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:49 smithi005 bash[35193]: cluster 2024-02-17T23:22:48.036374+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:50.086 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:49 smithi005 bash[38535]: cluster 2024-02-17T23:22:48.036374+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:50.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:49 smithi080 bash[35203]: cluster 2024-02-17T23:22:48.036374+0000 mgr.y (mgr.14140) 307 : cluster [DBG] pgmap v303: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:50.747 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-02-17T23:22:51.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:50 smithi005 bash[38535]: audit 2024-02-17T23:22:50.047927+0000 mon.a (mon.0) 638 : audit [INF] from='client.? 172.21.15.5:0/1158022346' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-17T23:22:51.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:50 smithi005 bash[38535]: audit 2024-02-17T23:22:50.052709+0000 mon.a (mon.0) 639 : audit [INF] from='client.? 172.21.15.5:0/1158022346' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-02-17T23:22:51.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:50 smithi005 bash[35193]: audit 2024-02-17T23:22:50.047927+0000 mon.a (mon.0) 638 : audit [INF] from='client.? 172.21.15.5:0/1158022346' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-17T23:22:51.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:50 smithi005 bash[35193]: audit 2024-02-17T23:22:50.052709+0000 mon.a (mon.0) 639 : audit [INF] from='client.? 172.21.15.5:0/1158022346' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-02-17T23:22:51.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:50 smithi080 bash[35203]: audit 2024-02-17T23:22:50.047927+0000 mon.a (mon.0) 638 : audit [INF] from='client.? 172.21.15.5:0/1158022346' entity='client.admin' cmd=[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]: dispatch 2024-02-17T23:22:51.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:50 smithi080 bash[35203]: audit 2024-02-17T23:22:50.052709+0000 mon.a (mon.0) 639 : audit [INF] from='client.? 172.21.15.5:0/1158022346' entity='client.admin' cmd='[{"prefix": "config set", "who": "mon", "name": "mon_warn_on_insecure_global_id_reclaim_allowed", "value": "false", "force": true}]': finished 2024-02-17T23:22:52.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:51 smithi005 bash[35193]: cluster 2024-02-17T23:22:50.036993+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:52.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:51 smithi005 bash[38535]: cluster 2024-02-17T23:22:50.036993+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:52.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:51 smithi080 bash[35203]: cluster 2024-02-17T23:22:50.036993+0000 mgr.y (mgr.14140) 308 : cluster [DBG] pgmap v304: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:53.024 INFO:teuthology.orchestra.run.smithi005.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-17T23:22:53.793 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-17T23:22:53.802 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-02-17T23:22:53.802 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-02-17T23:22:54.125 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:53 smithi005 bash[38535]: cluster 2024-02-17T23:22:52.037507+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:54.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:53 smithi005 bash[38535]: audit 2024-02-17T23:22:53.015923+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\"}"}]: dispatch 2024-02-17T23:22:54.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:53 smithi005 bash[38535]: audit 2024-02-17T23:22:53.018802+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\"}"}]': finished 2024-02-17T23:22:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:53 smithi005 bash[35193]: cluster 2024-02-17T23:22:52.037507+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:53 smithi005 bash[35193]: audit 2024-02-17T23:22:53.015923+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\"}"}]: dispatch 2024-02-17T23:22:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:53 smithi005 bash[35193]: audit 2024-02-17T23:22:53.018802+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\"}"}]': finished 2024-02-17T23:22:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:53 smithi080 bash[35203]: cluster 2024-02-17T23:22:52.037507+0000 mgr.y (mgr.14140) 309 : cluster [DBG] pgmap v305: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:53 smithi080 bash[35203]: audit 2024-02-17T23:22:53.015923+0000 mon.a (mon.0) 640 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\"}"}]: dispatch 2024-02-17T23:22:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:53 smithi080 bash[35203]: audit 2024-02-17T23:22:53.018802+0000 mon.a (mon.0) 641 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\"}"}]': finished 2024-02-17T23:22:54.835 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:54 smithi005 bash[38535]: audit 2024-02-17T23:22:53.015037+0000 mgr.y (mgr.14140) 310 : audit [DBG] from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:54.835 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:54 smithi005 bash[38535]: cephadm 2024-02-17T23:22:53.020952+0000 mgr.y (mgr.14140) 311 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-17T23:22:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:54 smithi005 bash[35193]: audit 2024-02-17T23:22:53.015037+0000 mgr.y (mgr.14140) 310 : audit [DBG] from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:54 smithi005 bash[35193]: cephadm 2024-02-17T23:22:53.020952+0000 mgr.y (mgr.14140) 311 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-17T23:22:55.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:54 smithi080 bash[35203]: audit 2024-02-17T23:22:53.015037+0000 mgr.y (mgr.14140) 310 : audit [DBG] from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:55.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:54 smithi080 bash[35203]: cephadm 2024-02-17T23:22:53.020952+0000 mgr.y (mgr.14140) 311 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-17T23:22:56.088 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:22:56.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:55 smithi005 bash[35193]: cluster 2024-02-17T23:22:54.037999+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:55 smithi005 bash[38535]: cluster 2024-02-17T23:22:54.037999+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:56.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:55 smithi080 bash[35203]: cluster 2024-02-17T23:22:54.037999+0000 mgr.y (mgr.14140) 312 : cluster [DBG] pgmap v306: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:56.661 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (3m) 2m ago 3m docker.io/prom/alertmanager:latest 9f27df16978d 5a9418a4188f 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (3m) 2m ago 3m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a5b65c6a5a44 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 bb165dd1d19c 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 88528bd095e9 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 627dfcd31839 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a3ec149a5abb 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (3m) 2m ago 4m docker.io/prom/node-exporter:latest 72c9c2088986 f95c680110b8 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (3m) 2m ago 4m docker.io/prom/node-exporter:latest 72c9c2088986 b8a0e0cba51e 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e7811399e7c1 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 61f8f838512a 2024-02-17T23:22:56.662 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:22:56.663 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:22:56.663 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:22:56.663 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (4m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:22:56.663 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:22:56.663 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (4m) 2m ago 4m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:22:56.663 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (3m) 2m ago 4m docker.io/prom/prometheus:latest 2a72b385beaf 8f923fa11fa3 2024-02-17T23:22:56.663 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:22:56.663 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:22:56.984 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:22:56.985 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:22:56.985 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:22:56.985 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:22:56.985 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-02-17T23:22:56.985 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:22:56.985 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:22:57.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:56 smithi005 bash[35193]: cluster 2024-02-17T23:22:56.038400+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:57.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:56 smithi005 bash[35193]: audit 2024-02-17T23:22:56.075684+0000 mgr.y (mgr.14140) 314 : audit [DBG] from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:57.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:56 smithi005 bash[35193]: audit 2024-02-17T23:22:56.371114+0000 mgr.y (mgr.14140) 315 : audit [DBG] from='client.24604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:57.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:56 smithi005 bash[35193]: audit 2024-02-17T23:22:56.656727+0000 mgr.y (mgr.14140) 316 : audit [DBG] from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:57.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:56 smithi005 bash[38535]: cluster 2024-02-17T23:22:56.038400+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:57.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:56 smithi005 bash[38535]: audit 2024-02-17T23:22:56.075684+0000 mgr.y (mgr.14140) 314 : audit [DBG] from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:57.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:56 smithi005 bash[38535]: audit 2024-02-17T23:22:56.371114+0000 mgr.y (mgr.14140) 315 : audit [DBG] from='client.24604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:57.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:56 smithi005 bash[38535]: audit 2024-02-17T23:22:56.656727+0000 mgr.y (mgr.14140) 316 : audit [DBG] from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:57.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:56 smithi080 bash[35203]: cluster 2024-02-17T23:22:56.038400+0000 mgr.y (mgr.14140) 313 : cluster [DBG] pgmap v307: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:22:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:56 smithi080 bash[35203]: audit 2024-02-17T23:22:56.075684+0000 mgr.y (mgr.14140) 314 : audit [DBG] from='client.24598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:56 smithi080 bash[35203]: audit 2024-02-17T23:22:56.371114+0000 mgr.y (mgr.14140) 315 : audit [DBG] from='client.24604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:56 smithi080 bash[35203]: audit 2024-02-17T23:22:56.656727+0000 mgr.y (mgr.14140) 316 : audit [DBG] from='client.24610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:57.287 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:22:57.287 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", 2024-02-17T23:22:57.287 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:22:57.287 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-02-17T23:22:57.287 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "" 2024-02-17T23:22:57.287 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:22:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:57 smithi005 bash[35193]: audit 2024-02-17T23:22:56.982370+0000 mon.a (mon.0) 642 : audit [DBG] from='client.? 172.21.15.5:0/1274095524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:22:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:57 smithi005 bash[35193]: audit 2024-02-17T23:22:57.285632+0000 mgr.y (mgr.14140) 317 : audit [DBG] from='client.14703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:57 smithi005 bash[38535]: audit 2024-02-17T23:22:56.982370+0000 mon.a (mon.0) 642 : audit [DBG] from='client.? 172.21.15.5:0/1274095524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:22:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:57 smithi005 bash[38535]: audit 2024-02-17T23:22:57.285632+0000 mgr.y (mgr.14140) 317 : audit [DBG] from='client.14703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:22:58.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:57 smithi080 bash[35203]: audit 2024-02-17T23:22:56.982370+0000 mon.a (mon.0) 642 : audit [DBG] from='client.? 172.21.15.5:0/1274095524' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:22:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:57 smithi080 bash[35203]: audit 2024-02-17T23:22:57.285632+0000 mgr.y (mgr.14140) 317 : audit [DBG] from='client.14703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:00.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:22:59 smithi005 bash[35193]: cluster 2024-02-17T23:22:58.038972+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:00.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:22:59 smithi005 bash[38535]: cluster 2024-02-17T23:22:58.038972+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:00.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:22:59 smithi080 bash[35203]: cluster 2024-02-17T23:22:58.038972+0000 mgr.y (mgr.14140) 318 : cluster [DBG] pgmap v308: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:01 smithi005 bash[35193]: cluster 2024-02-17T23:23:00.039392+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:02.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:01 smithi005 bash[38535]: cluster 2024-02-17T23:23:00.039392+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:02.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:01 smithi080 bash[35203]: cluster 2024-02-17T23:23:00.039392+0000 mgr.y (mgr.14140) 319 : cluster [DBG] pgmap v309: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:03 smithi005 bash[35193]: cluster 2024-02-17T23:23:02.039887+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:04.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:03 smithi005 bash[38535]: cluster 2024-02-17T23:23:02.039887+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:03 smithi080 bash[35203]: cluster 2024-02-17T23:23:02.039887+0000 mgr.y (mgr.14140) 320 : cluster [DBG] pgmap v310: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:06.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:05 smithi005 bash[35193]: cluster 2024-02-17T23:23:04.040473+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:06.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:05 smithi005 bash[38535]: cluster 2024-02-17T23:23:04.040473+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:06.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:05 smithi080 bash[35203]: cluster 2024-02-17T23:23:04.040473+0000 mgr.y (mgr.14140) 321 : cluster [DBG] pgmap v311: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:08.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:07 smithi005 bash[35193]: cluster 2024-02-17T23:23:06.040903+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:08.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:07 smithi005 bash[38535]: cluster 2024-02-17T23:23:06.040903+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:08.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:07 smithi080 bash[35203]: cluster 2024-02-17T23:23:06.040903+0000 mgr.y (mgr.14140) 322 : cluster [DBG] pgmap v312: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:09 smithi005 bash[35193]: cluster 2024-02-17T23:23:08.041440+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:10.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:09 smithi005 bash[38535]: cluster 2024-02-17T23:23:08.041440+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:10.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:09 smithi080 bash[35203]: cluster 2024-02-17T23:23:08.041440+0000 mgr.y (mgr.14140) 323 : cluster [DBG] pgmap v313: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:12.125 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:11 smithi005 bash[38535]: cluster 2024-02-17T23:23:10.042020+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:11 smithi005 bash[35193]: cluster 2024-02-17T23:23:10.042020+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:12.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:11 smithi080 bash[35203]: cluster 2024-02-17T23:23:10.042020+0000 mgr.y (mgr.14140) 324 : cluster [DBG] pgmap v314: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:14.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:13 smithi005 bash[35193]: cluster 2024-02-17T23:23:12.042738+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:14.134 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:13 smithi005 bash[38535]: cluster 2024-02-17T23:23:12.042738+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:14.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:13 smithi080 bash[35203]: cluster 2024-02-17T23:23:12.042738+0000 mgr.y (mgr.14140) 325 : cluster [DBG] pgmap v315: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:15 smithi005 bash[35193]: cluster 2024-02-17T23:23:14.043280+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:15 smithi005 bash[38535]: cluster 2024-02-17T23:23:14.043280+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:16.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:15 smithi080 bash[35203]: cluster 2024-02-17T23:23:14.043280+0000 mgr.y (mgr.14140) 326 : cluster [DBG] pgmap v316: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:17 smithi005 bash[35193]: cluster 2024-02-17T23:23:16.043715+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:18.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:17 smithi005 bash[38535]: cluster 2024-02-17T23:23:16.043715+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:18.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:17 smithi080 bash[35203]: cluster 2024-02-17T23:23:16.043715+0000 mgr.y (mgr.14140) 327 : cluster [DBG] pgmap v317: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:19 smithi005 bash[35193]: cluster 2024-02-17T23:23:18.044343+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:20.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:19 smithi005 bash[38535]: cluster 2024-02-17T23:23:18.044343+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:20.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:19 smithi080 bash[35203]: cluster 2024-02-17T23:23:18.044343+0000 mgr.y (mgr.14140) 328 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:22.125 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:21 smithi005 bash[35193]: cluster 2024-02-17T23:23:20.044850+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:22.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:21 smithi005 bash[38535]: cluster 2024-02-17T23:23:20.044850+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:22.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:21 smithi080 bash[35203]: cluster 2024-02-17T23:23:20.044850+0000 mgr.y (mgr.14140) 329 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:24.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:23 smithi005 bash[35193]: cluster 2024-02-17T23:23:22.045314+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:24.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:23 smithi005 bash[38535]: cluster 2024-02-17T23:23:22.045314+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:24.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:23 smithi080 bash[35203]: cluster 2024-02-17T23:23:22.045314+0000 mgr.y (mgr.14140) 330 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:25 smithi005 bash[35193]: cluster 2024-02-17T23:23:24.045782+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:26.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:25 smithi005 bash[38535]: cluster 2024-02-17T23:23:24.045782+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:26.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:25 smithi080 bash[35203]: cluster 2024-02-17T23:23:24.045782+0000 mgr.y (mgr.14140) 331 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:27.645 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:23:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:27 smithi005 bash[35193]: cluster 2024-02-17T23:23:26.046286+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:27 smithi005 bash[38535]: cluster 2024-02-17T23:23:26.046286+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:28.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:27 smithi080 bash[35203]: cluster 2024-02-17T23:23:26.046286+0000 mgr.y (mgr.14140) 332 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (3m) 2m ago 4m docker.io/prom/alertmanager:latest 9f27df16978d 5a9418a4188f 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (3m) 2m ago 3m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a5b65c6a5a44 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 bb165dd1d19c 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (9m) 2m ago 9m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 88528bd095e9 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 627dfcd31839 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (8m) 2m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a3ec149a5abb 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (4m) 2m ago 4m docker.io/prom/node-exporter:latest 72c9c2088986 f95c680110b8 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (4m) 2m ago 4m docker.io/prom/node-exporter:latest 72c9c2088986 b8a0e0cba51e 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e7811399e7c1 2024-02-17T23:23:28.235 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (7m) 2m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 61f8f838512a 2024-02-17T23:23:28.236 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:23:28.236 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:23:28.236 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (6m) 2m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:23:28.236 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:23:28.236 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:23:28.236 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (5m) 2m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:23:28.236 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (3m) 2m ago 4m docker.io/prom/prometheus:latest 2a72b385beaf 8f923fa11fa3 2024-02-17T23:23:28.236 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:23:28.236 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (2m) 2m ago 2m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:23:28.546 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:23:28.546 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-02-17T23:23:28.547 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:23:28.548 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:23:28.832 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:23:28.832 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", 2024-02-17T23:23:28.832 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:23:28.832 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-02-17T23:23:28.833 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "" 2024-02-17T23:23:28.833 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:23:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:28 smithi005 bash[35193]: audit 2024-02-17T23:23:27.631888+0000 mgr.y (mgr.14140) 333 : audit [DBG] from='client.14709 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:28 smithi005 bash[35193]: audit 2024-02-17T23:23:28.545416+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.5:0/4179786675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:23:29.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:28 smithi005 bash[38535]: audit 2024-02-17T23:23:27.631888+0000 mgr.y (mgr.14140) 333 : audit [DBG] from='client.14709 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:29.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:28 smithi005 bash[38535]: audit 2024-02-17T23:23:28.545416+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.5:0/4179786675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:23:29.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:28 smithi080 bash[35203]: audit 2024-02-17T23:23:27.631888+0000 mgr.y (mgr.14140) 333 : audit [DBG] from='client.14709 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:29.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:28 smithi080 bash[35203]: audit 2024-02-17T23:23:28.545416+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.5:0/4179786675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:23:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:29 smithi005 bash[35193]: audit 2024-02-17T23:23:27.950745+0000 mgr.y (mgr.14140) 334 : audit [DBG] from='client.14715 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:29 smithi005 bash[35193]: cluster 2024-02-17T23:23:28.046736+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:29 smithi005 bash[35193]: audit 2024-02-17T23:23:28.230323+0000 mgr.y (mgr.14140) 336 : audit [DBG] from='client.24634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:29 smithi005 bash[35193]: audit 2024-02-17T23:23:28.830878+0000 mgr.y (mgr.14140) 337 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:30.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:29 smithi005 bash[38535]: audit 2024-02-17T23:23:27.950745+0000 mgr.y (mgr.14140) 334 : audit [DBG] from='client.14715 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:30.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:29 smithi005 bash[38535]: cluster 2024-02-17T23:23:28.046736+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:29 smithi005 bash[38535]: audit 2024-02-17T23:23:28.230323+0000 mgr.y (mgr.14140) 336 : audit [DBG] from='client.24634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:29 smithi005 bash[38535]: audit 2024-02-17T23:23:28.830878+0000 mgr.y (mgr.14140) 337 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:30.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:29 smithi080 bash[35203]: audit 2024-02-17T23:23:27.950745+0000 mgr.y (mgr.14140) 334 : audit [DBG] from='client.14715 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:30.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:29 smithi080 bash[35203]: cluster 2024-02-17T23:23:28.046736+0000 mgr.y (mgr.14140) 335 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:29 smithi080 bash[35203]: audit 2024-02-17T23:23:28.230323+0000 mgr.y (mgr.14140) 336 : audit [DBG] from='client.24634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:29 smithi080 bash[35203]: audit 2024-02-17T23:23:28.830878+0000 mgr.y (mgr.14140) 337 : audit [DBG] from='client.14733 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:23:31.780 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:31 smithi005 bash[38535]: cluster 2024-02-17T23:23:30.047279+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:31.781 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:31 smithi005 bash[38535]: audit 2024-02-17T23:23:31.418343+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_version\": \"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)\"}"}]: dispatch 2024-02-17T23:23:31.781 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:31 smithi005 bash[38535]: audit 2024-02-17T23:23:31.421609+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_version\": \"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)\"}"}]': finished 2024-02-17T23:23:31.781 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:31 smithi005 bash[38535]: audit 2024-02-17T23:23:31.422162+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:23:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:31 smithi005 bash[35193]: cluster 2024-02-17T23:23:30.047279+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:31 smithi005 bash[35193]: audit 2024-02-17T23:23:31.418343+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_version\": \"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)\"}"}]: dispatch 2024-02-17T23:23:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:31 smithi005 bash[35193]: audit 2024-02-17T23:23:31.421609+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_version\": \"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)\"}"}]': finished 2024-02-17T23:23:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:31 smithi005 bash[35193]: audit 2024-02-17T23:23:31.422162+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:23:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:31 smithi080 bash[35203]: cluster 2024-02-17T23:23:30.047279+0000 mgr.y (mgr.14140) 338 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:31 smithi080 bash[35203]: audit 2024-02-17T23:23:31.418343+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_version\": \"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)\"}"}]: dispatch 2024-02-17T23:23:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:31 smithi080 bash[35203]: audit 2024-02-17T23:23:31.421609+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_version\": \"ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)\"}"}]': finished 2024-02-17T23:23:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:31 smithi080 bash[35203]: audit 2024-02-17T23:23:31.422162+0000 mon.a (mon.0) 645 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:23:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:32 smithi005 bash[35193]: cephadm 2024-02-17T23:23:31.421944+0000 mgr.y (mgr.14140) 339 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 with id 823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa 2024-02-17T23:23:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:32 smithi005 bash[35193]: cephadm 2024-02-17T23:23:31.422987+0000 mgr.y (mgr.14140) 340 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-17T23:23:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:32 smithi005 bash[35193]: cephadm 2024-02-17T23:23:31.423242+0000 mgr.y (mgr.14140) 341 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-17T23:23:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:32 smithi005 bash[35193]: cephadm 2024-02-17T23:23:31.631364+0000 mgr.y (mgr.14140) 342 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 on smithi080 2024-02-17T23:23:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:32 smithi005 bash[38535]: cephadm 2024-02-17T23:23:31.421944+0000 mgr.y (mgr.14140) 339 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 with id 823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa 2024-02-17T23:23:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:32 smithi005 bash[38535]: cephadm 2024-02-17T23:23:31.422987+0000 mgr.y (mgr.14140) 340 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-17T23:23:33.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:32 smithi005 bash[38535]: cephadm 2024-02-17T23:23:31.423242+0000 mgr.y (mgr.14140) 341 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-17T23:23:33.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:32 smithi005 bash[38535]: cephadm 2024-02-17T23:23:31.631364+0000 mgr.y (mgr.14140) 342 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 on smithi080 2024-02-17T23:23:33.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:32 smithi080 bash[35203]: cephadm 2024-02-17T23:23:31.421944+0000 mgr.y (mgr.14140) 339 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 with id 823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa 2024-02-17T23:23:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:32 smithi080 bash[35203]: cephadm 2024-02-17T23:23:31.422987+0000 mgr.y (mgr.14140) 340 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-17T23:23:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:32 smithi080 bash[35203]: cephadm 2024-02-17T23:23:31.423242+0000 mgr.y (mgr.14140) 341 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-17T23:23:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:32 smithi080 bash[35203]: cephadm 2024-02-17T23:23:31.631364+0000 mgr.y (mgr.14140) 342 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 on smithi080 2024-02-17T23:23:34.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:33 smithi005 bash[35193]: cluster 2024-02-17T23:23:32.047837+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:34.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:33 smithi005 bash[38535]: cluster 2024-02-17T23:23:32.047837+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:34.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:33 smithi080 bash[35203]: cluster 2024-02-17T23:23:32.047837+0000 mgr.y (mgr.14140) 343 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:35 smithi005 bash[35193]: cluster 2024-02-17T23:23:34.048392+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:35 smithi005 bash[38535]: cluster 2024-02-17T23:23:34.048392+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:36.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:35 smithi080 bash[35203]: cluster 2024-02-17T23:23:34.048392+0000 mgr.y (mgr.14140) 344 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:38.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:37 smithi005 bash[35193]: cluster 2024-02-17T23:23:36.048882+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:38.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:37 smithi005 bash[38535]: cluster 2024-02-17T23:23:36.048882+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:37 smithi080 bash[35203]: cluster 2024-02-17T23:23:36.048882+0000 mgr.y (mgr.14140) 345 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:40.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:39 smithi005 bash[35193]: cluster 2024-02-17T23:23:38.049499+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:40.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:39 smithi005 bash[38535]: cluster 2024-02-17T23:23:38.049499+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:39 smithi080 bash[35203]: cluster 2024-02-17T23:23:38.049499+0000 mgr.y (mgr.14140) 346 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:41 smithi005 bash[35193]: cluster 2024-02-17T23:23:40.050179+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:42.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:41 smithi005 bash[38535]: cluster 2024-02-17T23:23:40.050179+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:42.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:41 smithi080 bash[35203]: cluster 2024-02-17T23:23:40.050179+0000 mgr.y (mgr.14140) 347 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:44.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:43 smithi005 bash[35193]: cluster 2024-02-17T23:23:42.050908+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:44.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:43 smithi005 bash[38535]: cluster 2024-02-17T23:23:42.050908+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:44.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:43 smithi080 bash[35203]: cluster 2024-02-17T23:23:42.050908+0000 mgr.y (mgr.14140) 348 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:45 smithi005 bash[35193]: cluster 2024-02-17T23:23:44.051647+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:45 smithi005 bash[38535]: cluster 2024-02-17T23:23:44.051647+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:46.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:45 smithi080 bash[35203]: cluster 2024-02-17T23:23:44.051647+0000 mgr.y (mgr.14140) 349 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:47 smithi005 bash[35193]: cluster 2024-02-17T23:23:46.052220+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:47 smithi005 bash[38535]: cluster 2024-02-17T23:23:46.052220+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:48.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:47 smithi080 bash[35203]: cluster 2024-02-17T23:23:46.052220+0000 mgr.y (mgr.14140) 350 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:49 smithi005 bash[35193]: cluster 2024-02-17T23:23:48.052855+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:50.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:49 smithi005 bash[38535]: cluster 2024-02-17T23:23:48.052855+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:50.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:49 smithi080 bash[35203]: cluster 2024-02-17T23:23:48.052855+0000 mgr.y (mgr.14140) 351 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:52.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:51 smithi005 bash[35193]: cluster 2024-02-17T23:23:50.053481+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:52.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:51 smithi005 bash[38535]: cluster 2024-02-17T23:23:50.053481+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:52.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:51 smithi080 bash[35203]: cluster 2024-02-17T23:23:50.053481+0000 mgr.y (mgr.14140) 352 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:53 smithi005 bash[35193]: cluster 2024-02-17T23:23:52.054243+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:54.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:53 smithi005 bash[38535]: cluster 2024-02-17T23:23:52.054243+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:54.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:53 smithi080 bash[35203]: cluster 2024-02-17T23:23:52.054243+0000 mgr.y (mgr.14140) 353 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:55 smithi005 bash[35193]: cluster 2024-02-17T23:23:54.054783+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:55 smithi005 bash[38535]: cluster 2024-02-17T23:23:54.054783+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:56.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:55 smithi080 bash[35203]: cluster 2024-02-17T23:23:54.054783+0000 mgr.y (mgr.14140) 354 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:58.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:57 smithi005 bash[35193]: cluster 2024-02-17T23:23:56.055350+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:57 smithi005 bash[38535]: cluster 2024-02-17T23:23:56.055350+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:58.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:57 smithi080 bash[35203]: cluster 2024-02-17T23:23:56.055350+0000 mgr.y (mgr.14140) 355 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:23:59.141 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:23:59.691 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST STATUS REFRESHED AGE VERSION IMAGE NAME IMAGE ID CONTAINER ID 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (4m) 3m ago 4m docker.io/prom/alertmanager:latest 9f27df16978d 5a9418a4188f 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (4m) 3m ago 4m 6.6.2 docker.io/ceph/ceph-grafana:latest 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a5b65c6a5a44 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 bb165dd1d19c 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (10m) 3m ago 10m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 88528bd095e9 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 627dfcd31839 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (8m) 3m ago 8m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 a3ec149a5abb 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (4m) 3m ago 5m docker.io/prom/node-exporter:latest 72c9c2088986 f95c680110b8 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (4m) 3m ago 5m docker.io/prom/node-exporter:latest 72c9c2088986 b8a0e0cba51e 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e7811399e7c1 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 61f8f838512a 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (7m) 3m ago 7m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:23:59.692 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:23:59.693 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (6m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:23:59.693 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (5m) 3m ago 6m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:23:59.693 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:23:59.693 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (5m) 3m ago 5m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:23:59.693 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (4m) 3m ago 5m docker.io/prom/prometheus:latest 2a72b385beaf 8f923fa11fa3 2024-02-17T23:23:59.693 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:23:59.693 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (3m) 3m ago 3m 15.2.0 docker.io/ceph/ceph:v15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:23:59.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:23:59 smithi080 bash[35203]: cluster 2024-02-17T23:23:58.056110+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:00.000 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:24:00.000 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:24:00.000 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:24:00.001 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 15 2024-02-17T23:24:00.002 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:24:00.002 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:24:00.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:23:59 smithi005 bash[35193]: cluster 2024-02-17T23:23:58.056110+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:00.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:23:59 smithi005 bash[38535]: cluster 2024-02-17T23:23:58.056110+0000 mgr.y (mgr.14140) 356 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:00.290 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:24:00.291 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", 2024-02-17T23:24:00.291 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:24:00.291 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-02-17T23:24:00.291 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "" 2024-02-17T23:24:00.291 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:24:00.934 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:00 smithi080 bash[35203]: audit 2024-02-17T23:23:59.128828+0000 mgr.y (mgr.14140) 357 : audit [DBG] from='client.14739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:00.934 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:00 smithi080 bash[35203]: audit 2024-02-17T23:23:59.409396+0000 mgr.y (mgr.14140) 358 : audit [DBG] from='client.24658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:00.934 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:00 smithi080 bash[35203]: audit 2024-02-17T23:23:59.687111+0000 mgr.y (mgr.14140) 359 : audit [DBG] from='client.14751 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:00.934 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:00 smithi080 bash[35203]: audit 2024-02-17T23:23:59.999290+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.5:0/2358101654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:24:00.935 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:00 smithi080 bash[35203]: audit 2024-02-17T23:24:00.276095+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", "who": "mgr.x"}]: dispatch 2024-02-17T23:24:00.935 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:00 smithi080 bash[35203]: audit 2024-02-17T23:24:00.279850+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", "who": "mgr.x"}]': finished 2024-02-17T23:24:00.935 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:00 smithi080 bash[35203]: audit 2024-02-17T23:24:00.280580+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-17T23:24:00.935 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:00 smithi080 bash[35203]: audit 2024-02-17T23:24:00.281220+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:00.935 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:00 smithi080 bash[35203]: audit 2024-02-17T23:24:00.282103+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-17T23:24:01.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[35193]: audit 2024-02-17T23:23:59.128828+0000 mgr.y (mgr.14140) 357 : audit [DBG] from='client.14739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:01.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[35193]: audit 2024-02-17T23:23:59.409396+0000 mgr.y (mgr.14140) 358 : audit [DBG] from='client.24658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:01.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[35193]: audit 2024-02-17T23:23:59.687111+0000 mgr.y (mgr.14140) 359 : audit [DBG] from='client.14751 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:01.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[35193]: audit 2024-02-17T23:23:59.999290+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.5:0/2358101654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:24:01.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[35193]: audit 2024-02-17T23:24:00.276095+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", "who": "mgr.x"}]: dispatch 2024-02-17T23:24:01.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[35193]: audit 2024-02-17T23:24:00.279850+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", "who": "mgr.x"}]': finished 2024-02-17T23:24:01.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[35193]: audit 2024-02-17T23:24:00.280580+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-17T23:24:01.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[35193]: audit 2024-02-17T23:24:00.281220+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:01.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[35193]: audit 2024-02-17T23:24:00.282103+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-17T23:24:01.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[38535]: audit 2024-02-17T23:23:59.128828+0000 mgr.y (mgr.14140) 357 : audit [DBG] from='client.14739 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:01.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[38535]: audit 2024-02-17T23:23:59.409396+0000 mgr.y (mgr.14140) 358 : audit [DBG] from='client.24658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:01.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[38535]: audit 2024-02-17T23:23:59.687111+0000 mgr.y (mgr.14140) 359 : audit [DBG] from='client.14751 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:01.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[38535]: audit 2024-02-17T23:23:59.999290+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.5:0/2358101654' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:24:01.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[38535]: audit 2024-02-17T23:24:00.276095+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", "who": "mgr.x"}]: dispatch 2024-02-17T23:24:01.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[38535]: audit 2024-02-17T23:24:00.279850+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", "who": "mgr.x"}]': finished 2024-02-17T23:24:01.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[38535]: audit 2024-02-17T23:24:00.280580+0000 mon.a (mon.0) 648 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2024-02-17T23:24:01.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[38535]: audit 2024-02-17T23:24:00.281220+0000 mon.a (mon.0) 649 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:01.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:00 smithi005 bash[38535]: audit 2024-02-17T23:24:00.282103+0000 mon.a (mon.0) 650 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2024-02-17T23:24:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:01 smithi005 bash[35193]: cluster 2024-02-17T23:24:00.056561+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:01 smithi005 bash[35193]: cephadm 2024-02-17T23:24:00.275756+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2024-02-17T23:24:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:01 smithi005 bash[35193]: cephadm 2024-02-17T23:24:00.275808+0000 mgr.y (mgr.14140) 362 : cephadm [INF] Upgrade: Redeploying mgr.x 2024-02-17T23:24:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:01 smithi005 bash[35193]: cephadm 2024-02-17T23:24:00.281725+0000 mgr.y (mgr.14140) 363 : cephadm [INF] Deploying daemon mgr.x on smithi080 2024-02-17T23:24:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:01 smithi005 bash[35193]: audit 2024-02-17T23:24:00.288873+0000 mgr.y (mgr.14140) 364 : audit [DBG] from='client.14763 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:02.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:01 smithi005 bash[38535]: cluster 2024-02-17T23:24:00.056561+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:02.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:01 smithi005 bash[38535]: cephadm 2024-02-17T23:24:00.275756+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2024-02-17T23:24:02.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:01 smithi005 bash[38535]: cephadm 2024-02-17T23:24:00.275808+0000 mgr.y (mgr.14140) 362 : cephadm [INF] Upgrade: Redeploying mgr.x 2024-02-17T23:24:02.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:01 smithi005 bash[38535]: cephadm 2024-02-17T23:24:00.281725+0000 mgr.y (mgr.14140) 363 : cephadm [INF] Deploying daemon mgr.x on smithi080 2024-02-17T23:24:02.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:01 smithi005 bash[38535]: audit 2024-02-17T23:24:00.288873+0000 mgr.y (mgr.14140) 364 : audit [DBG] from='client.14763 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:02.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:01 smithi080 systemd[1]: Stopping Ceph mgr.x for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:24:02.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:01 smithi080 bash[35203]: cluster 2024-02-17T23:24:00.056561+0000 mgr.y (mgr.14140) 360 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:02.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:01 smithi080 bash[35203]: cephadm 2024-02-17T23:24:00.275756+0000 mgr.y (mgr.14140) 361 : cephadm [INF] Upgrade: It is presumed safe to stop mgr.x 2024-02-17T23:24:02.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:01 smithi080 bash[35203]: cephadm 2024-02-17T23:24:00.275808+0000 mgr.y (mgr.14140) 362 : cephadm [INF] Upgrade: Redeploying mgr.x 2024-02-17T23:24:02.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:01 smithi080 bash[35203]: cephadm 2024-02-17T23:24:00.281725+0000 mgr.y (mgr.14140) 363 : cephadm [INF] Deploying daemon mgr.x on smithi080 2024-02-17T23:24:02.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:01 smithi080 bash[35203]: audit 2024-02-17T23:24:00.288873+0000 mgr.y (mgr.14140) 364 : audit [DBG] from='client.14763 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:03 smithi005 bash[35193]: cluster 2024-02-17T23:24:02.057179+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:04.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:03 smithi005 bash[38535]: cluster 2024-02-17T23:24:02.057179+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:04.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:03 smithi080 bash[35203]: cluster 2024-02-17T23:24:02.057179+0000 mgr.y (mgr.14140) 365 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:06.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:05 smithi005 bash[35193]: cluster 2024-02-17T23:24:04.057781+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:06.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:05 smithi005 bash[38535]: cluster 2024-02-17T23:24:04.057781+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:06.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:05 smithi080 bash[35203]: cluster 2024-02-17T23:24:04.057781+0000 mgr.y (mgr.14140) 366 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:07.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:06 smithi005 bash[35193]: cluster 2024-02-17T23:24:06.058487+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:07.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:06 smithi005 bash[38535]: cluster 2024-02-17T23:24:06.058487+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:07.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:06 smithi080 bash[35203]: cluster 2024-02-17T23:24:06.058487+0000 mgr.y (mgr.14140) 367 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:09 smithi005 bash[35193]: cluster 2024-02-17T23:24:08.059211+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:10.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:09 smithi005 bash[38535]: cluster 2024-02-17T23:24:08.059211+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:10.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:09 smithi080 bash[35203]: cluster 2024-02-17T23:24:08.059211+0000 mgr.y (mgr.14140) 368 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:12.041 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:11 smithi080 bash[35203]: cluster 2024-02-17T23:24:10.059786+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:11 smithi005 bash[35193]: cluster 2024-02-17T23:24:10.059786+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:12.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:11 smithi005 bash[38535]: cluster 2024-02-17T23:24:10.059786+0000 mgr.y (mgr.14140) 369 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:12.390 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:12 smithi080 podman[48531]: time="2024-02-17T23:24:12Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.x in 10 seconds, resorting to SIGKILL" 2024-02-17T23:24:12.765 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:12 smithi080 podman[48531]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.x 2024-02-17T23:24:13.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:12 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.x.service: Main process exited, code=exited, status=137/n/a 2024-02-17T23:24:13.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:12 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-02-17T23:24:13.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:12 smithi080 systemd[1]: Stopped Ceph mgr.x for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:24:13.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:12 smithi080 systemd[1]: Starting Ceph mgr.x for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:24:13.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:12 smithi080 podman[48608]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.x" found: no such container 2024-02-17T23:24:13.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:12 smithi080 systemd[1]: Started Ceph mgr.x for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:24:14.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:13 smithi005 bash[35193]: cluster 2024-02-17T23:24:12.060316+0000 mgr.y (mgr.14140) 370 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:14.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:13 smithi005 bash[38535]: cluster 2024-02-17T23:24:12.060316+0000 mgr.y (mgr.14140) 370 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:14.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:13 smithi005 bash[35193]: audit 2024-02-17T23:24:12.969565+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:24:14.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:13 smithi005 bash[35193]: audit 2024-02-17T23:24:12.973223+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:24:14.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:13 smithi005 bash[35193]: audit 2024-02-17T23:24:12.974045+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:24:14.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:13 smithi005 bash[38535]: audit 2024-02-17T23:24:12.969565+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:13 smithi005 bash[38535]: audit 2024-02-17T23:24:12.973223+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:24:14.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:13 smithi005 bash[38535]: audit 2024-02-17T23:24:12.974045+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:24:14.139 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:13 smithi080 bash[48624]: debug 2024-02-17T23:24:13.591+0000 7f43c98b5700 1 -- 172.21.15.80:0/1052928961 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555a4d7484e0 con 0x555a4d71d400 2024-02-17T23:24:14.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:13 smithi080 bash[48624]: debug 2024-02-17T23:24:13.711+0000 7f43d9eb0680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T23:24:14.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:13 smithi080 bash[48624]: debug 2024-02-17T23:24:13.794+0000 7f43d9eb0680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T23:24:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:13 smithi080 bash[35203]: cluster 2024-02-17T23:24:12.060316+0000 mgr.y (mgr.14140) 370 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:13 smithi080 bash[35203]: audit 2024-02-17T23:24:12.969565+0000 mon.a (mon.0) 651 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:24:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:13 smithi080 bash[35203]: audit 2024-02-17T23:24:12.973223+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798021\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"status\": 1, \"status_desc\": \"starting\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798186\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798223\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798259\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798293\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798326\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798360\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798394\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:20:52.798427\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:24:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:13 smithi080 bash[35203]: audit 2024-02-17T23:24:12.974045+0000 mon.a (mon.0) 653 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2024-02-17T23:24:14.462 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:14 smithi080 bash[48624]: debug 2024-02-17T23:24:14.163+0000 7f43d9eb0680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T23:24:15.139 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:14 smithi080 bash[48624]: debug 2024-02-17T23:24:14.935+0000 7f43d9eb0680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T23:24:15.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:15 smithi080 bash[48624]: debug 2024-02-17T23:24:15.019+0000 7f43d9eb0680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T23:24:15.639 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:15 smithi080 bash[48624]: debug 2024-02-17T23:24:15.228+0000 7f43d9eb0680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T23:24:16.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:15 smithi005 bash[35193]: cluster 2024-02-17T23:24:14.061030+0000 mgr.y (mgr.14140) 371 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:16.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:15 smithi005 bash[38535]: cluster 2024-02-17T23:24:14.061030+0000 mgr.y (mgr.14140) 371 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:16.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:15 smithi080 bash[35203]: cluster 2024-02-17T23:24:14.061030+0000 mgr.y (mgr.14140) 371 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:16.594 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:16 smithi080 bash[48624]: debug 2024-02-17T23:24:16.214+0000 7f43d9eb0680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T23:24:16.595 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:16 smithi080 bash[48624]: debug 2024-02-17T23:24:16.341+0000 7f43d9eb0680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:24:16.595 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:16 smithi080 bash[48624]: debug 2024-02-17T23:24:16.419+0000 7f43d9eb0680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T23:24:16.889 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:16 smithi080 bash[48624]: debug 2024-02-17T23:24:16.509+0000 7f43d9eb0680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T23:24:16.890 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:16 smithi080 bash[48624]: debug 2024-02-17T23:24:16.702+0000 7f43d9eb0680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T23:24:17.338 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:16 smithi080 bash[48624]: debug 2024-02-17T23:24:16.983+0000 7f43d9eb0680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T23:24:17.338 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:17 smithi080 bash[48624]: debug 2024-02-17T23:24:17.081+0000 7f43d9eb0680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T23:24:18.025 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:17 smithi080 bash[48624]: debug 2024-02-17T23:24:17.814+0000 7f43d9eb0680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T23:24:18.026 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:17 smithi080 bash[48624]: debug 2024-02-17T23:24:17.894+0000 7f43d9eb0680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T23:24:18.026 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:17 smithi080 bash[35203]: cluster 2024-02-17T23:24:16.061656+0000 mgr.y (mgr.14140) 372 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:17 smithi005 bash[35193]: cluster 2024-02-17T23:24:16.061656+0000 mgr.y (mgr.14140) 372 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:18.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:17 smithi005 bash[38535]: cluster 2024-02-17T23:24:16.061656+0000 mgr.y (mgr.14140) 372 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:18.390 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:18 smithi080 bash[48624]: debug 2024-02-17T23:24:17.986+0000 7f43d9eb0680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T23:24:18.390 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:18 smithi080 bash[48624]: debug 2024-02-17T23:24:18.158+0000 7f43d9eb0680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T23:24:18.689 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:18 smithi080 bash[48624]: debug 2024-02-17T23:24:18.423+0000 7f43d9eb0680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T23:24:18.690 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:18 smithi080 bash[48624]: debug 2024-02-17T23:24:18.554+0000 7f43d9eb0680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T23:24:18.955 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:18 smithi080 bash[48624]: debug 2024-02-17T23:24:18.687+0000 7f43d9eb0680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:24:18.955 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:18 smithi080 bash[48624]: debug 2024-02-17T23:24:18.860+0000 7f43d9eb0680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T23:24:19.390 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:18 smithi080 bash[48624]: debug 2024-02-17T23:24:18.953+0000 7f43d9eb0680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T23:24:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[35193]: cluster 2024-02-17T23:24:18.062308+0000 mgr.y (mgr.14140) 373 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[35193]: cluster 2024-02-17T23:24:18.968515+0000 mon.a (mon.0) 654 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:24:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[35193]: cluster 2024-02-17T23:24:18.968639+0000 mon.a (mon.0) 655 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:24:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[35193]: audit 2024-02-17T23:24:18.968995+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:24:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[35193]: audit 2024-02-17T23:24:18.969317+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:24:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[35193]: audit 2024-02-17T23:24:18.970168+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:24:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[35193]: audit 2024-02-17T23:24:18.970422+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:24:20.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[38535]: cluster 2024-02-17T23:24:18.062308+0000 mgr.y (mgr.14140) 373 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:20.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[38535]: cluster 2024-02-17T23:24:18.968515+0000 mon.a (mon.0) 654 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:24:20.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[38535]: cluster 2024-02-17T23:24:18.968639+0000 mon.a (mon.0) 655 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:24:20.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[38535]: audit 2024-02-17T23:24:18.968995+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:24:20.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[38535]: audit 2024-02-17T23:24:18.969317+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:24:20.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[38535]: audit 2024-02-17T23:24:18.970168+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:24:20.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:19 smithi005 bash[38535]: audit 2024-02-17T23:24:18.970422+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:24:20.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:19 smithi080 bash[35203]: cluster 2024-02-17T23:24:18.062308+0000 mgr.y (mgr.14140) 373 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:20.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:19 smithi080 bash[35203]: cluster 2024-02-17T23:24:18.968515+0000 mon.a (mon.0) 654 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:24:20.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:19 smithi080 bash[35203]: cluster 2024-02-17T23:24:18.968639+0000 mon.a (mon.0) 655 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:24:20.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:19 smithi080 bash[35203]: audit 2024-02-17T23:24:18.968995+0000 mon.b (mon.2) 24 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:24:20.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:19 smithi080 bash[35203]: audit 2024-02-17T23:24:18.969317+0000 mon.b (mon.2) 25 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:24:20.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:19 smithi080 bash[35203]: audit 2024-02-17T23:24:18.970168+0000 mon.b (mon.2) 26 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:24:20.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:19 smithi080 bash[35203]: audit 2024-02-17T23:24:18.970422+0000 mon.b (mon.2) 27 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:24:21.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[35193]: cluster 2024-02-17T23:24:19.768533+0000 mon.a (mon.0) 656 : cluster [DBG] mgrmap e15: y(active, since 9m), standbys: x 2024-02-17T23:24:21.028 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[38535]: cluster 2024-02-17T23:24:19.768533+0000 mon.a (mon.0) 656 : cluster [DBG] mgrmap e15: y(active, since 9m), standbys: x 2024-02-17T23:24:21.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[35193]: audit 2024-02-17T23:24:20.559289+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.557909\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558007\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:24:12.968874\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558046\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558094\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558133\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558165\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558197\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558229\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558261\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558293\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:24:20.558393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:24:21.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[35193]: audit 2024-02-17T23:24:20.562730+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.557909\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558007\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:24:12.968874\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558046\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558094\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558133\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558165\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558197\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558229\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558261\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558293\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:24:20.558393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:24:21.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[35193]: audit 2024-02-17T23:24:20.565352+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:24:21.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[35193]: audit 2024-02-17T23:24:20.569121+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-02-17T23:24:21.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[35193]: cluster 2024-02-17T23:24:20.573692+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-17T23:24:21.029 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[38535]: audit 2024-02-17T23:24:20.559289+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.557909\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558007\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:24:12.968874\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558046\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558094\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558133\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558165\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558197\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558229\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558261\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558293\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:24:20.558393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:24:21.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[38535]: audit 2024-02-17T23:24:20.562730+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.557909\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558007\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:24:12.968874\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558046\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558094\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558133\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558165\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558197\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558229\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558261\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558293\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:24:20.558393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:24:21.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[38535]: audit 2024-02-17T23:24:20.565352+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:24:21.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[38535]: audit 2024-02-17T23:24:20.569121+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-02-17T23:24:21.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:20 smithi005 bash[38535]: cluster 2024-02-17T23:24:20.573692+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-17T23:24:21.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:20 smithi080 bash[35203]: cluster 2024-02-17T23:24:19.768533+0000 mon.a (mon.0) 656 : cluster [DBG] mgrmap e15: y(active, since 9m), standbys: x 2024-02-17T23:24:21.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:20 smithi080 bash[35203]: audit 2024-02-17T23:24:20.559289+0000 mon.a (mon.0) 657 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.557909\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558007\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:24:12.968874\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558046\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558094\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558133\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558165\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558197\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558229\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558261\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558293\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:24:20.558393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]: dispatch 2024-02-17T23:24:21.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:20 smithi080 bash[35203]: audit 2024-02-17T23:24:20.562730+0000 mon.a (mon.0) 658 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"b\", \"daemon_type\": \"mon\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.557909\", \"created\": \"2024-02-17T23:15:26.652314\", \"started\": \"2024-02-17T23:15:26.687297\"}, \"mgr.x\": {\"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"daemon_id\": \"x\", \"daemon_type\": \"mgr\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558007\", \"created\": \"2024-02-17T23:15:43.142949\", \"started\": \"2024-02-17T23:24:12.968874\"}, \"osd.4\": {\"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"4\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558046\", \"created\": \"2024-02-17T23:17:18.964823\", \"started\": \"2024-02-17T23:17:22.809211\"}, \"osd.5\": {\"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"5\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558094\", \"created\": \"2024-02-17T23:17:37.782405\", \"started\": \"2024-02-17T23:18:00.964544\"}, \"osd.6\": {\"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"6\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558133\", \"created\": \"2024-02-17T23:18:02.056866\", \"started\": \"2024-02-17T23:18:05.879274\"}, \"osd.7\": {\"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"7\", \"daemon_type\": \"osd\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558165\", \"created\": \"2024-02-17T23:18:22.301417\", \"started\": \"2024-02-17T23:18:24.312602\"}, \"prometheus.a\": {\"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"prometheus\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558197\", \"created\": \"2024-02-17T23:18:52.289751\", \"started\": \"2024-02-17T23:19:56.199355\"}, \"node-exporter.b\": {\"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"daemon_id\": \"b\", \"daemon_type\": \"node-exporter\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558229\", \"created\": \"2024-02-17T23:18:55.150687\", \"started\": \"2024-02-17T23:19:03.916708\"}, \"grafana.a\": {\"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"daemon_id\": \"a\", \"daemon_type\": \"grafana\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558261\", \"created\": \"2024-02-17T23:19:34.269818\", \"started\": \"2024-02-17T23:19:34.380225\"}, \"rgw.r.z.smithi080.qdwuig\": {\"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_type\": \"rgw\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"last_refresh\": \"2024-02-17T23:24:20.558293\", \"created\": \"2024-02-17T23:20:42.486301\", \"started\": \"2024-02-17T23:20:42.517492\"}}, \"devices\": [{\"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\"}, {\"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\"}], \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234\"}}, \"last_daemon_update\": \"2024-02-17T23:24:20.558393\", \"last_device_update\": \"2024-02-17T23:18:28.954439\", \"networks\": {\"172.21.0.0/20\": [\"172.21.15.80\"]}, \"last_host_check\": \"2024-02-17T23:14:53.184926\"}"}]': finished 2024-02-17T23:24:21.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:20 smithi080 bash[35203]: audit 2024-02-17T23:24:20.565352+0000 mon.a (mon.0) 659 : audit [DBG] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:24:21.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:20 smithi080 bash[35203]: audit 2024-02-17T23:24:20.569121+0000 mon.a (mon.0) 660 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd=[{"prefix": "mgr fail", "who": "y"}]: dispatch 2024-02-17T23:24:21.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:20 smithi080 bash[35203]: cluster 2024-02-17T23:24:20.573692+0000 mon.a (mon.0) 661 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2024-02-17T23:24:21.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[35426]: ignoring --setuser ceph since I am not root 2024-02-17T23:24:21.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[35426]: ignoring --setgroup ceph since I am not root 2024-02-17T23:24:21.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[35193]: cluster 2024-02-17T23:24:20.062879+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:21.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[35193]: cephadm 2024-02-17T23:24:20.565072+0000 mgr.y (mgr.14140) 375 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 with id 823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa 2024-02-17T23:24:21.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[35193]: cephadm 2024-02-17T23:24:20.566299+0000 mgr.y (mgr.14140) 376 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-17T23:24:21.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[35193]: cephadm 2024-02-17T23:24:20.566734+0000 mgr.y (mgr.14140) 377 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[35193]: cephadm 2024-02-17T23:24:20.568598+0000 mgr.y (mgr.14140) 378 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[35193]: cluster 2024-02-17T23:24:20.910451+0000 mon.a (mon.0) 662 : cluster [DBG] Standby manager daemon y started 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[35193]: audit 2024-02-17T23:24:21.569190+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[35193]: cluster 2024-02-17T23:24:21.569245+0000 mon.a (mon.0) 664 : cluster [DBG] mgrmap e16: x(active, starting, since 0.999626s), standbys: y 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[38535]: cluster 2024-02-17T23:24:20.062879+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[38535]: cephadm 2024-02-17T23:24:20.565072+0000 mgr.y (mgr.14140) 375 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 with id 823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[38535]: cephadm 2024-02-17T23:24:20.566299+0000 mgr.y (mgr.14140) 376 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[38535]: cephadm 2024-02-17T23:24:20.566734+0000 mgr.y (mgr.14140) 377 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[38535]: cephadm 2024-02-17T23:24:20.568598+0000 mgr.y (mgr.14140) 378 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[38535]: cluster 2024-02-17T23:24:20.910451+0000 mon.a (mon.0) 662 : cluster [DBG] Standby manager daemon y started 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[38535]: audit 2024-02-17T23:24:21.569190+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-02-17T23:24:21.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:21 smithi005 bash[38535]: cluster 2024-02-17T23:24:21.569245+0000 mon.a (mon.0) 664 : cluster [DBG] mgrmap e16: x(active, starting, since 0.999626s), standbys: y 2024-02-17T23:24:21.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:21 smithi080 bash[35203]: cluster 2024-02-17T23:24:20.062879+0000 mgr.y (mgr.14140) 374 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 7.0 KiB data, 5.5 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:21.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:21 smithi080 bash[35203]: cephadm 2024-02-17T23:24:20.565072+0000 mgr.y (mgr.14140) 375 : cephadm [INF] Upgrade: Target is quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 with id 823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa 2024-02-17T23:24:21.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:21 smithi080 bash[35203]: cephadm 2024-02-17T23:24:20.566299+0000 mgr.y (mgr.14140) 376 : cephadm [INF] Upgrade: Checking mgr daemons... 2024-02-17T23:24:21.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:21 smithi080 bash[35203]: cephadm 2024-02-17T23:24:20.566734+0000 mgr.y (mgr.14140) 377 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.y) 2024-02-17T23:24:21.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:21 smithi080 bash[35203]: cephadm 2024-02-17T23:24:20.568598+0000 mgr.y (mgr.14140) 378 : cephadm [INF] Upgrade: there are 1 other already-upgraded standby mgrs, failing over 2024-02-17T23:24:21.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:21 smithi080 bash[35203]: cluster 2024-02-17T23:24:20.910451+0000 mon.a (mon.0) 662 : cluster [DBG] Standby manager daemon y started 2024-02-17T23:24:21.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:21 smithi080 bash[35203]: audit 2024-02-17T23:24:21.569190+0000 mon.a (mon.0) 663 : audit [INF] from='mgr.14140 172.21.15.5:0/2277589585' entity='mgr.y' cmd='[{"prefix": "mgr fail", "who": "y"}]': finished 2024-02-17T23:24:21.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:21 smithi080 bash[35203]: cluster 2024-02-17T23:24:21.569245+0000 mon.a (mon.0) 664 : cluster [DBG] mgrmap e16: x(active, starting, since 0.999626s), standbys: y 2024-02-17T23:24:25.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:25 smithi005 bash[38535]: cluster 2024-02-17T23:24:25.364117+0000 mon.a (mon.0) 665 : cluster [DBG] Standby manager daemon y restarted 2024-02-17T23:24:25.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:25 smithi005 bash[38535]: cluster 2024-02-17T23:24:25.364199+0000 mon.a (mon.0) 666 : cluster [DBG] Standby manager daemon y started 2024-02-17T23:24:25.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:25 smithi005 bash[38535]: audit 2024-02-17T23:24:25.365277+0000 mon.a (mon.0) 667 : audit [DBG] from='mgr.? 172.21.15.5:0/3631009408' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:24:25.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:25 smithi005 bash[38535]: audit 2024-02-17T23:24:25.366353+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.? 172.21.15.5:0/3631009408' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:24:25.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:25 smithi005 bash[35193]: cluster 2024-02-17T23:24:25.364117+0000 mon.a (mon.0) 665 : cluster [DBG] Standby manager daemon y restarted 2024-02-17T23:24:25.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:25 smithi005 bash[35193]: cluster 2024-02-17T23:24:25.364199+0000 mon.a (mon.0) 666 : cluster [DBG] Standby manager daemon y started 2024-02-17T23:24:25.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:25 smithi005 bash[35193]: audit 2024-02-17T23:24:25.365277+0000 mon.a (mon.0) 667 : audit [DBG] from='mgr.? 172.21.15.5:0/3631009408' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:24:25.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:25 smithi005 bash[35193]: audit 2024-02-17T23:24:25.366353+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.? 172.21.15.5:0/3631009408' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:24:25.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:25 smithi080 bash[35203]: cluster 2024-02-17T23:24:25.364117+0000 mon.a (mon.0) 665 : cluster [DBG] Standby manager daemon y restarted 2024-02-17T23:24:25.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:25 smithi080 bash[35203]: cluster 2024-02-17T23:24:25.364199+0000 mon.a (mon.0) 666 : cluster [DBG] Standby manager daemon y started 2024-02-17T23:24:25.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:25 smithi080 bash[35203]: audit 2024-02-17T23:24:25.365277+0000 mon.a (mon.0) 667 : audit [DBG] from='mgr.? 172.21.15.5:0/3631009408' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:24:25.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:25 smithi080 bash[35203]: audit 2024-02-17T23:24:25.366353+0000 mon.a (mon.0) 668 : audit [DBG] from='mgr.? 172.21.15.5:0/3631009408' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:24:26.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:26 smithi005 bash[35193]: cluster 2024-02-17T23:24:25.420726+0000 mon.a (mon.0) 669 : cluster [DBG] mgrmap e17: x(active, starting, since 4s), standbys: y 2024-02-17T23:24:26.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:26 smithi005 bash[35193]: audit 2024-02-17T23:24:25.423087+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:24:26.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:26 smithi005 bash[35193]: audit 2024-02-17T23:24:25.423184+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:24:26.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:26 smithi005 bash[38535]: cluster 2024-02-17T23:24:25.420726+0000 mon.a (mon.0) 669 : cluster [DBG] mgrmap e17: x(active, starting, since 4s), standbys: y 2024-02-17T23:24:26.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:26 smithi005 bash[38535]: audit 2024-02-17T23:24:25.423087+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:24:26.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:26 smithi005 bash[38535]: audit 2024-02-17T23:24:25.423184+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:24:26.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:26 smithi080 bash[35203]: cluster 2024-02-17T23:24:25.420726+0000 mon.a (mon.0) 669 : cluster [DBG] mgrmap e17: x(active, starting, since 4s), standbys: y 2024-02-17T23:24:26.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:26 smithi080 bash[35203]: audit 2024-02-17T23:24:25.423087+0000 mon.b (mon.2) 28 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:24:26.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:26 smithi080 bash[35203]: audit 2024-02-17T23:24:25.423184+0000 mon.b (mon.2) 29 : audit [DBG] from='mgr.? 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:24:27.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.569671+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:24:27.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.569910+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:24:27.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.570114+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.571370+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.571613+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.571831+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.572054+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.572256+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.572479+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.572689+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.572895+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.574198+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.574392+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.574860+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.575591+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.576398+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.576666+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-17T23:24:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.576943+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi005"}]: dispatch 2024-02-17T23:24:27.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.569671+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:24:27.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.569910+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:24:27.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.570114+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:24:27.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.571370+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:24:27.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.571613+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:24:27.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.571831+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:24:27.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.572054+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:24:27.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.572256+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.572479+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.572689+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.572895+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.574198+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.574392+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.574860+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.575591+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.576398+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.576666+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.576943+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi005"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.577215+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.577479+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.577727+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.578004+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.578261+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-17T23:24:27.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.578512+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.578775+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.579047+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.579301+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.579572+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.579833+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.580091+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.580343+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.580597+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.580862+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.581124+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.581391+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:24:27.880 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.577215+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.577479+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.577727+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.578004+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.578261+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.578512+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.578775+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.579047+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.579301+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.579572+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.579833+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.580091+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.580343+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.580597+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.580862+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-17T23:24:27.881 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.581124+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-17T23:24:27.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.581391+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:24:27.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: audit 2024-02-17T23:24:27.581650+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:24:27.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[35193]: cluster 2024-02-17T23:24:27.608859+0000 mon.a (mon.0) 670 : cluster [INF] Manager daemon x is now available 2024-02-17T23:24:27.882 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: audit 2024-02-17T23:24:27.581650+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:24:27.882 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:27 smithi005 bash[38535]: cluster 2024-02-17T23:24:27.608859+0000 mon.a (mon.0) 670 : cluster [INF] Manager daemon x is now available 2024-02-17T23:24:27.889 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[48624]: Warning: Permanently added '172.21.15.5' (ECDSA) to the list of known hosts. 2024-02-17T23:24:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.569671+0000 mon.b (mon.2) 30 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:24:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.569910+0000 mon.b (mon.2) 31 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:24:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.570114+0000 mon.b (mon.2) 32 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:24:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.571370+0000 mon.b (mon.2) 33 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:24:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.571613+0000 mon.b (mon.2) 34 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:24:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.571831+0000 mon.b (mon.2) 35 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:24:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.572054+0000 mon.b (mon.2) 36 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:24:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.572256+0000 mon.b (mon.2) 37 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:24:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.572479+0000 mon.b (mon.2) 38 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.572689+0000 mon.b (mon.2) 39 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.572895+0000 mon.b (mon.2) 40 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.574198+0000 mon.b (mon.2) 41 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.574392+0000 mon.b (mon.2) 42 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.574860+0000 mon.b (mon.2) 43 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.575591+0000 mon.b (mon.2) 44 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.576398+0000 mon.b (mon.2) 45 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.576666+0000 mon.b (mon.2) 46 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.576943+0000 mon.b (mon.2) 47 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi005"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.577215+0000 mon.b (mon.2) 48 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.577479+0000 mon.b (mon.2) 49 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.577727+0000 mon.b (mon.2) 50 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.578004+0000 mon.b (mon.2) 51 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.578261+0000 mon.b (mon.2) 52 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.578512+0000 mon.b (mon.2) 53 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-17T23:24:27.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.578775+0000 mon.b (mon.2) 54 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.579047+0000 mon.b (mon.2) 55 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.579301+0000 mon.b (mon.2) 56 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.579572+0000 mon.b (mon.2) 57 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.579833+0000 mon.b (mon.2) 58 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.580091+0000 mon.b (mon.2) 59 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.580343+0000 mon.b (mon.2) 60 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.580597+0000 mon.b (mon.2) 61 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.580862+0000 mon.b (mon.2) 62 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.581124+0000 mon.b (mon.2) 63 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.581391+0000 mon.b (mon.2) 64 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: audit 2024-02-17T23:24:27.581650+0000 mon.b (mon.2) 65 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:24:27.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:27 smithi080 bash[35203]: cluster 2024-02-17T23:24:27.608859+0000 mon.a (mon.0) 670 : cluster [INF] Manager daemon x is now available 2024-02-17T23:24:28.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: cephadm 2024-02-17T23:24:27.619608+0000 mgr.x (mgr.34652) 1 : cephadm [INF] inventory: adjusted host smithi005 addr 'smithi005' -> '172.21.15.5' 2024-02-17T23:24:28.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.620056+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:24:28.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.621074+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:24:28.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.632431+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-17T23:24:28.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: cephadm 2024-02-17T23:24:27.636597+0000 mgr.x (mgr.34652) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-17T23:24:28.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.636865+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-17T23:24:28.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.637324+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-17T23:24:28.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.641903+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-02-17T23:24:28.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: cluster 2024-02-17T23:24:27.667537+0000 mon.a (mon.0) 675 : cluster [DBG] mgrmap e18: x(active, since 7s), standbys: y 2024-02-17T23:24:28.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: cluster 2024-02-17T23:24:27.670878+0000 mgr.x (mgr.34652) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.730005+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.730763+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: cephadm 2024-02-17T23:24:27.619608+0000 mgr.x (mgr.34652) 1 : cephadm [INF] inventory: adjusted host smithi005 addr 'smithi005' -> '172.21.15.5' 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.620056+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.621074+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.632431+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: cephadm 2024-02-17T23:24:27.636597+0000 mgr.x (mgr.34652) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.636865+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.637324+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.641903+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-02-17T23:24:28.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: cluster 2024-02-17T23:24:27.667537+0000 mon.a (mon.0) 675 : cluster [DBG] mgrmap e18: x(active, since 7s), standbys: y 2024-02-17T23:24:28.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: cluster 2024-02-17T23:24:27.670878+0000 mgr.x (mgr.34652) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:28.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.730005+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-17T23:24:28.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.730763+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-17T23:24:28.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.733916+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-02-17T23:24:28.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.735158+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:24:28.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.736438+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:24:28.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.768207+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:24:28.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.769102+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:24:28.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.773563+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-17T23:24:28.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[35193]: audit 2024-02-17T23:24:27.773961+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-17T23:24:28.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.733916+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-02-17T23:24:28.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.735158+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:24:28.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.736438+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:24:28.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.768207+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:24:28.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.769102+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:24:28.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.773563+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-17T23:24:28.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:28 smithi005 bash[38535]: audit 2024-02-17T23:24:27.773961+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-17T23:24:28.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: cephadm 2024-02-17T23:24:27.619608+0000 mgr.x (mgr.34652) 1 : cephadm [INF] inventory: adjusted host smithi005 addr 'smithi005' -> '172.21.15.5' 2024-02-17T23:24:28.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.620056+0000 mon.b (mon.2) 66 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:24:28.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.621074+0000 mon.a (mon.0) 671 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:24:28.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.632431+0000 mon.a (mon.0) 672 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"smithi080\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-17T23:24:28.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: cephadm 2024-02-17T23:24:27.636597+0000 mgr.x (mgr.34652) 2 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-02-17T23:24:28.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.636865+0000 mon.b (mon.2) 67 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-17T23:24:28.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.637324+0000 mon.a (mon.0) 673 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]: dispatch 2024-02-17T23:24:28.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.641903+0000 mon.a (mon.0) 674 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"5","who":"mgr","name":"mgr/cephadm/migration_current"}]': finished 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: cluster 2024-02-17T23:24:27.667537+0000 mon.a (mon.0) 675 : cluster [DBG] mgrmap e18: x(active, since 7s), standbys: y 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: cluster 2024-02-17T23:24:27.670878+0000 mgr.x (mgr.34652) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.730005+0000 mon.b (mon.2) 68 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.730763+0000 mon.a (mon.0) 676 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]: dispatch 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.733916+0000 mon.a (mon.0) 677 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/config_checks","val":"{\"kernel_security\": \"enabled\", \"os_subscription\": \"enabled\", \"public_network\": \"enabled\", \"osd_mtu_size\": \"enabled\", \"osd_linkspeed\": \"enabled\", \"network_missing\": \"enabled\", \"ceph_release\": \"enabled\", \"kernel_version\": \"enabled\"}"}]': finished 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.735158+0000 mon.b (mon.2) 69 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.736438+0000 mon.b (mon.2) 70 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.768207+0000 mon.b (mon.2) 71 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.769102+0000 mon.a (mon.0) 678 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.773563+0000 mon.b (mon.2) 72 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-17T23:24:28.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:28 smithi080 bash[35203]: audit 2024-02-17T23:24:27.773961+0000 mon.a (mon.0) 679 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-02-17T23:24:29.747 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:29 smithi005 bash[35193]: cluster 2024-02-17T23:24:29.574453+0000 mgr.x (mgr.34652) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:30.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:29 smithi005 bash[38535]: cluster 2024-02-17T23:24:29.574453+0000 mgr.x (mgr.34652) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:29 smithi080 bash[35203]: cluster 2024-02-17T23:24:29.574453+0000 mgr.x (mgr.34652) 4 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:30.644 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:24:31.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:30 smithi005 bash[35193]: cluster 2024-02-17T23:24:29.749420+0000 mon.a (mon.0) 680 : cluster [DBG] mgrmap e19: x(active, since 9s), standbys: y 2024-02-17T23:24:31.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:30 smithi005 bash[38535]: cluster 2024-02-17T23:24:29.749420+0000 mon.a (mon.0) 680 : cluster [DBG] mgrmap e19: x(active, since 9s), standbys: y 2024-02-17T23:24:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:30 smithi080 bash[35203]: cluster 2024-02-17T23:24:29.749420+0000 mon.a (mon.0) 680 : cluster [DBG] mgrmap e19: x(active, since 9s), standbys: y 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (4m) 3m ago 5m - - 9f27df16978d 5a9418a4188f 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (4m) 10s ago 4m - - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 running (18s) 10s ago 8m - - 16.2.14-548-g81bd20d6 823b921721f5 8c3856f00a71 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 running (10m) 3m ago 10m - - 15.2.0 204a01f9b0b6 bb165dd1d19c 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (10m) 3m ago 10m - 2048M 15.2.0 204a01f9b0b6 88528bd095e9 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (9m) 10s ago 9m - 2048M 15.2.0 204a01f9b0b6 627dfcd31839 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (9m) 3m ago 9m - 2048M 15.2.0 204a01f9b0b6 a3ec149a5abb 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (5m) 3m ago 5m - - 72c9c2088986 f95c680110b8 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (5m) 10s ago 5m - - 72c9c2088986 b8a0e0cba51e 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (8m) 3m ago 8m - 4096M 15.2.0 204a01f9b0b6 e7811399e7c1 2024-02-17T23:24:31.280 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (8m) 3m ago 8m - 4096M 15.2.0 204a01f9b0b6 61f8f838512a 2024-02-17T23:24:31.281 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (7m) 3m ago 7m - 4096M 15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:24:31.281 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (7m) 3m ago 7m - 4096M 15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:24:31.281 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (7m) 10s ago 7m - 4096M 15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:24:31.281 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (6m) 10s ago 6m - 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:24:31.281 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (6m) 10s ago 6m - 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:24:31.281 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (6m) 10s ago 6m - 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:24:31.281 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (4m) 10s ago 5m - - 2a72b385beaf 8f923fa11fa3 2024-02-17T23:24:31.281 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (3m) 3m ago 3m - - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:24:31.281 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (3m) 10s ago 3m - - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:24:31.660 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 1 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:24:31.661 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:24:31.662 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:24:31.662 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:24:31.662 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:24:31.662 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14, 2024-02-17T23:24:31.662 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 1 2024-02-17T23:24:31.662 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:24:31.662 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:24:31.987 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:24:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", 2024-02-17T23:24:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:24:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:24:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-02-17T23:24:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "", 2024-02-17T23:24:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-02-17T23:24:31.988 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:24:31.988 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:24:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:30.631191+0000 mgr.x (mgr.34652) 5 : audit [DBG] from='client.24703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:30.955211+0000 mgr.x (mgr.34652) 6 : audit [DBG] from='client.14799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.265072+0000 mgr.x (mgr.34652) 7 : audit [DBG] from='client.14805 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.267285+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:24:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.267798+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:24:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.268201+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.268568+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.268927+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.269273+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.271305+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.271736+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.272140+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.272529+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.272920+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: cluster 2024-02-17T23:24:31.574887+0000 mgr.x (mgr.34652) 8 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[35193]: audit 2024-02-17T23:24:31.659585+0000 mon.a (mon.0) 681 : audit [DBG] from='client.? 172.21.15.5:0/1698212975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:30.631191+0000 mgr.x (mgr.34652) 5 : audit [DBG] from='client.24703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:30.955211+0000 mgr.x (mgr.34652) 6 : audit [DBG] from='client.14799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.265072+0000 mgr.x (mgr.34652) 7 : audit [DBG] from='client.14805 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:32.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.267285+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.267798+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.268201+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.268568+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.268927+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.269273+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.271305+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.271736+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.272140+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.272529+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.272920+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: cluster 2024-02-17T23:24:31.574887+0000 mgr.x (mgr.34652) 8 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:32.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:31 smithi005 bash[38535]: audit 2024-02-17T23:24:31.659585+0000 mon.a (mon.0) 681 : audit [DBG] from='client.? 172.21.15.5:0/1698212975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:24:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:30.631191+0000 mgr.x (mgr.34652) 5 : audit [DBG] from='client.24703 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:30.955211+0000 mgr.x (mgr.34652) 6 : audit [DBG] from='client.14799 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.265072+0000 mgr.x (mgr.34652) 7 : audit [DBG] from='client.14805 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.267285+0000 mon.b (mon.2) 73 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.267798+0000 mon.b (mon.2) 74 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.268201+0000 mon.b (mon.2) 75 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.268568+0000 mon.b (mon.2) 76 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.268927+0000 mon.b (mon.2) 77 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.269273+0000 mon.b (mon.2) 78 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.271305+0000 mon.b (mon.2) 79 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.271736+0000 mon.b (mon.2) 80 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.272140+0000 mon.b (mon.2) 81 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.272529+0000 mon.b (mon.2) 82 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.272920+0000 mon.b (mon.2) 83 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: cluster 2024-02-17T23:24:31.574887+0000 mgr.x (mgr.34652) 8 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:32.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:31 smithi080 bash[35203]: audit 2024-02-17T23:24:31.659585+0000 mon.a (mon.0) 681 : audit [DBG] from='client.? 172.21.15.5:0/1698212975' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:24:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:32 smithi005 bash[35193]: audit 2024-02-17T23:24:31.986006+0000 mgr.x (mgr.34652) 9 : audit [DBG] from='client.24727 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:33.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:32 smithi005 bash[38535]: audit 2024-02-17T23:24:31.986006+0000 mgr.x (mgr.34652) 9 : audit [DBG] from='client.24727 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:32 smithi080 bash[35203]: audit 2024-02-17T23:24:31.986006+0000 mgr.x (mgr.34652) 9 : audit [DBG] from='client.24727 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:24:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:33 smithi005 bash[35193]: cluster 2024-02-17T23:24:33.575558+0000 mgr.x (mgr.34652) 10 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:33 smithi005 bash[38535]: cluster 2024-02-17T23:24:33.575558+0000 mgr.x (mgr.34652) 10 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:34.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:33 smithi080 bash[35203]: cluster 2024-02-17T23:24:33.575558+0000 mgr.x (mgr.34652) 10 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:35 smithi005 bash[35193]: cluster 2024-02-17T23:24:35.576149+0000 mgr.x (mgr.34652) 11 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:35 smithi005 bash[38535]: cluster 2024-02-17T23:24:35.576149+0000 mgr.x (mgr.34652) 11 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:36.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:35 smithi080 bash[35203]: cluster 2024-02-17T23:24:35.576149+0000 mgr.x (mgr.34652) 11 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:37.994 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:37 smithi005 bash[35193]: cluster 2024-02-17T23:24:37.576596+0000 mgr.x (mgr.34652) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:37.994 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:37 smithi005 bash[38535]: cluster 2024-02-17T23:24:37.576596+0000 mgr.x (mgr.34652) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:37 smithi080 bash[35203]: cluster 2024-02-17T23:24:37.576596+0000 mgr.x (mgr.34652) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:39.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[48624]: Warning: Permanently added 'smithi080,172.21.15.80' (ECDSA) to the list of known hosts. 2024-02-17T23:24:40.090 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.141634+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-17T23:24:40.090 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.142404+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-17T23:24:40.090 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.146584+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]': finished 2024-02-17T23:24:40.090 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.150161+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.x"}]: dispatch 2024-02-17T23:24:40.090 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.150605+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.x"}]: dispatch 2024-02-17T23:24:40.090 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.154468+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.x"}]': finished 2024-02-17T23:24:40.091 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.411917+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766808Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766893Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766928Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766959Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766988Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767018Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767048Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767087Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767123Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767153Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:40.091 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.141634+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-17T23:24:40.091 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.142404+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-17T23:24:40.091 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.146584+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]': finished 2024-02-17T23:24:40.091 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.150161+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.x"}]: dispatch 2024-02-17T23:24:40.091 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.150605+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.x"}]: dispatch 2024-02-17T23:24:40.091 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.154468+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.x"}]': finished 2024-02-17T23:24:40.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.412596+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766808Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766893Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766928Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766959Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766988Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767018Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767048Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767087Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767123Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767153Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:40.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.415440+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766808Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766893Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766928Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766959Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766988Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767018Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767048Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767087Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767123Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767153Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:40.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.418541+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:24:40.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: audit 2024-02-17T23:24:39.431854+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:24:40.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[35193]: cluster 2024-02-17T23:24:39.577377+0000 mgr.x (mgr.34652) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:40.093 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.411917+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766808Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766893Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766928Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766959Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766988Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767018Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767048Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767087Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767123Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767153Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:40.093 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.412596+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766808Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766893Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766928Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766959Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766988Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767018Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767048Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767087Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767123Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767153Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:40.093 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.415440+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766808Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766893Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766928Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766959Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766988Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767018Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767048Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767087Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767123Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767153Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:40.093 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.418541+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:24:40.093 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: audit 2024-02-17T23:24:39.431854+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:24:40.093 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:39 smithi005 bash[38535]: cluster 2024-02-17T23:24:39.577377+0000 mgr.x (mgr.34652) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.141634+0000 mon.b (mon.2) 84 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.142404+0000 mon.a (mon.0) 682 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]: dispatch 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.146584+0000 mon.a (mon.0) 683 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992", "who": "global"}]': finished 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.150161+0000 mon.b (mon.2) 85 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.x"}]: dispatch 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.150605+0000 mon.a (mon.0) 684 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.x"}]: dispatch 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.154468+0000 mon.a (mon.0) 685 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.x"}]': finished 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.411917+0000 mon.b (mon.2) 86 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766808Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766893Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766928Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766959Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766988Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767018Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767048Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767087Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767123Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767153Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.412596+0000 mon.a (mon.0) 686 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766808Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766893Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766928Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766959Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766988Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767018Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767048Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767087Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767123Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767153Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.415440+0000 mon.a (mon.0) 687 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766808Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766893Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766928Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766959Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.766988Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767018Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767048Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767087Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767123Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:20:48.767153Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.418541+0000 mon.b (mon.2) 87 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: audit 2024-02-17T23:24:39.431854+0000 mon.b (mon.2) 88 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:24:40.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:39 smithi080 bash[35203]: cluster 2024-02-17T23:24:39.577377+0000 mgr.x (mgr.34652) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:41.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:41 smithi080 bash[35203]: cluster 2024-02-17T23:24:41.577959+0000 mgr.x (mgr.34652) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:41.993 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:41 smithi005 bash[35193]: cluster 2024-02-17T23:24:41.577959+0000 mgr.x (mgr.34652) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:41.993 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:41 smithi005 bash[38535]: cluster 2024-02-17T23:24:41.577959+0000 mgr.x (mgr.34652) 14 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:43.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:43 smithi080 bash[35203]: cluster 2024-02-17T23:24:43.578812+0000 mgr.x (mgr.34652) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:43.996 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:43 smithi005 bash[35193]: cluster 2024-02-17T23:24:43.578812+0000 mgr.x (mgr.34652) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:43.997 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:43 smithi005 bash[38535]: cluster 2024-02-17T23:24:43.578812+0000 mgr.x (mgr.34652) 15 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:45.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:43.778190+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:45.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:43.778190+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:45.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:43.779128+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:45.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:43.782005+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:45.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:44.101768+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:44.102152+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:44.102432+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:44.102712+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:44.103027+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:44.103301+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:44.103656+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:44.104042+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[38535]: audit 2024-02-17T23:24:44.104376+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:43.779128+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:43.782005+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:44.101768+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:44.102152+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:44.102432+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:44.102712+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:44.103027+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:44.103301+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:44.103656+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:44.104042+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:44 smithi005 bash[35193]: audit 2024-02-17T23:24:44.104376+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:43.778190+0000 mon.b (mon.2) 89 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:45.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:43.779128+0000 mon.a (mon.0) 688 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:45.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:43.782005+0000 mon.a (mon.0) 689 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:45.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:44.101768+0000 mon.b (mon.2) 90 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:44.102152+0000 mon.b (mon.2) 91 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:44.102432+0000 mon.b (mon.2) 92 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:44.102712+0000 mon.b (mon.2) 93 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:44.103027+0000 mon.b (mon.2) 94 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:44.103301+0000 mon.b (mon.2) 95 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:44.103656+0000 mon.b (mon.2) 96 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:45.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:44.104042+0000 mon.b (mon.2) 97 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:45.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:44 smithi080 bash[35203]: audit 2024-02-17T23:24:44.104376+0000 mon.b (mon.2) 98 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.121444+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:46.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.121444+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:46.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.122229+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:46.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.122229+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.125915+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.425726+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.426078+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.426366+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.426613+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.426852+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.427065+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.427310+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.427532+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.427761+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.428849+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.429468+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:24:46.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.432562+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.125915+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.425726+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.426078+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.426366+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.426613+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.426852+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.427065+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.427310+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.427532+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.427761+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.428849+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:24:46.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.429468+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:24:46.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.432562+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:24:46.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: cephadm 2024-02-17T23:24:45.435250+0000 mgr.x (mgr.34652) 16 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-17T23:24:46.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.435482+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:24:46.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.435997+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:24:46.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.436430+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:46.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: cephadm 2024-02-17T23:24:45.436856+0000 mgr.x (mgr.34652) 17 : cephadm [INF] Reconfiguring daemon mon.a on smithi005 2024-02-17T23:24:46.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: audit 2024-02-17T23:24:45.437154+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-17T23:24:46.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[35193]: cluster 2024-02-17T23:24:45.579157+0000 mgr.x (mgr.34652) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:46.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: cephadm 2024-02-17T23:24:45.435250+0000 mgr.x (mgr.34652) 16 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-17T23:24:46.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.435482+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:24:46.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.435997+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:24:46.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.436430+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:46.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: cephadm 2024-02-17T23:24:45.436856+0000 mgr.x (mgr.34652) 17 : cephadm [INF] Reconfiguring daemon mon.a on smithi005 2024-02-17T23:24:46.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: audit 2024-02-17T23:24:45.437154+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-17T23:24:46.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:45 smithi005 bash[38535]: cluster 2024-02-17T23:24:45.579157+0000 mgr.x (mgr.34652) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:46.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.121444+0000 mon.b (mon.2) 99 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.122229+0000 mon.a (mon.0) 690 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.125915+0000 mon.a (mon.0) 691 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:15.155167Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.425726+0000 mon.b (mon.2) 100 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.426078+0000 mon.b (mon.2) 101 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.426366+0000 mon.b (mon.2) 102 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.426613+0000 mon.b (mon.2) 103 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.426852+0000 mon.b (mon.2) 104 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.427065+0000 mon.b (mon.2) 105 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.427310+0000 mon.b (mon.2) 106 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.427532+0000 mon.b (mon.2) 107 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.427761+0000 mon.b (mon.2) 108 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.428849+0000 mon.b (mon.2) 109 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.429468+0000 mon.a (mon.0) 692 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.432562+0000 mon.a (mon.0) 693 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: cephadm 2024-02-17T23:24:45.435250+0000 mgr.x (mgr.34652) 16 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.435482+0000 mon.b (mon.2) 110 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.435997+0000 mon.b (mon.2) 111 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.436430+0000 mon.b (mon.2) 112 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: cephadm 2024-02-17T23:24:45.436856+0000 mgr.x (mgr.34652) 17 : cephadm [INF] Reconfiguring daemon mon.a on smithi005 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: audit 2024-02-17T23:24:45.437154+0000 mon.b (mon.2) 113 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-17T23:24:46.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:45 smithi080 bash[35203]: cluster 2024-02-17T23:24:45.579157+0000 mgr.x (mgr.34652) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:47.695 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[35193]: audit 2024-02-17T23:24:47.176232+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:47.695 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[38535]: audit 2024-02-17T23:24:47.176232+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:47.696 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[35193]: audit 2024-02-17T23:24:47.177004+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:47.696 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[35193]: audit 2024-02-17T23:24:47.180012+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:47.696 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[35193]: audit 2024-02-17T23:24:47.181358+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:24:47.696 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[35193]: audit 2024-02-17T23:24:47.182071+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:24:47.696 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[35193]: audit 2024-02-17T23:24:47.182748+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:47.696 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[35193]: audit 2024-02-17T23:24:47.183766+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-17T23:24:47.697 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[38535]: audit 2024-02-17T23:24:47.177004+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:47.697 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[38535]: audit 2024-02-17T23:24:47.180012+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:47.697 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[38535]: audit 2024-02-17T23:24:47.181358+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:24:47.697 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[38535]: audit 2024-02-17T23:24:47.182071+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:24:47.697 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[38535]: audit 2024-02-17T23:24:47.182748+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:47.697 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:47 smithi005 bash[38535]: audit 2024-02-17T23:24:47.183766+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-17T23:24:47.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:47 smithi080 bash[35203]: audit 2024-02-17T23:24:47.176232+0000 mon.b (mon.2) 114 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:47.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:47 smithi080 bash[35203]: audit 2024-02-17T23:24:47.177004+0000 mon.a (mon.0) 694 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:24:47.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:47 smithi080 bash[35203]: audit 2024-02-17T23:24:47.180012+0000 mon.a (mon.0) 695 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:03.216529Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:24:47.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:47 smithi080 bash[35203]: audit 2024-02-17T23:24:47.181358+0000 mon.b (mon.2) 115 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:24:47.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:47 smithi080 bash[35203]: audit 2024-02-17T23:24:47.182071+0000 mon.b (mon.2) 116 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:24:47.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:47 smithi080 bash[35203]: audit 2024-02-17T23:24:47.182748+0000 mon.b (mon.2) 117 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:47.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:47 smithi080 bash[35203]: audit 2024-02-17T23:24:47.183766+0000 mon.b (mon.2) 118 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-17T23:24:48.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:48 smithi005 bash[35193]: cephadm 2024-02-17T23:24:47.181087+0000 mgr.x (mgr.34652) 19 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-17T23:24:48.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:48 smithi005 bash[35193]: cephadm 2024-02-17T23:24:47.183363+0000 mgr.x (mgr.34652) 20 : cephadm [INF] Reconfiguring daemon mon.c on smithi005 2024-02-17T23:24:48.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:48 smithi005 bash[35193]: cluster 2024-02-17T23:24:47.579607+0000 mgr.x (mgr.34652) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:48.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:48 smithi005 bash[38535]: cephadm 2024-02-17T23:24:47.181087+0000 mgr.x (mgr.34652) 19 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-17T23:24:48.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:48 smithi005 bash[38535]: cephadm 2024-02-17T23:24:47.183363+0000 mgr.x (mgr.34652) 20 : cephadm [INF] Reconfiguring daemon mon.c on smithi005 2024-02-17T23:24:48.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:48 smithi005 bash[38535]: cluster 2024-02-17T23:24:47.579607+0000 mgr.x (mgr.34652) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:48.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:48 smithi080 bash[35203]: cephadm 2024-02-17T23:24:47.181087+0000 mgr.x (mgr.34652) 19 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-17T23:24:48.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:48 smithi080 bash[35203]: cephadm 2024-02-17T23:24:47.183363+0000 mgr.x (mgr.34652) 20 : cephadm [INF] Reconfiguring daemon mon.c on smithi005 2024-02-17T23:24:48.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:48 smithi080 bash[35203]: cluster 2024-02-17T23:24:47.579607+0000 mgr.x (mgr.34652) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:50.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[35193]: audit 2024-02-17T23:24:48.841473+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:50.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[35193]: audit 2024-02-17T23:24:48.842514+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:50.029 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[38535]: audit 2024-02-17T23:24:48.841473+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:50.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[35193]: audit 2024-02-17T23:24:48.845722+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:24:50.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[35193]: cephadm 2024-02-17T23:24:48.847054+0000 mgr.x (mgr.34652) 22 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-17T23:24:50.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[35193]: cephadm 2024-02-17T23:24:48.858402+0000 mgr.x (mgr.34652) 23 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi005 2024-02-17T23:24:50.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[35193]: cluster 2024-02-17T23:24:49.580282+0000 mgr.x (mgr.34652) 24 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:50.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[38535]: audit 2024-02-17T23:24:48.842514+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:50.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[38535]: audit 2024-02-17T23:24:48.845722+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:24:50.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[38535]: cephadm 2024-02-17T23:24:48.847054+0000 mgr.x (mgr.34652) 22 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-17T23:24:50.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[38535]: cephadm 2024-02-17T23:24:48.858402+0000 mgr.x (mgr.34652) 23 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi005 2024-02-17T23:24:50.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:49 smithi005 bash[38535]: cluster 2024-02-17T23:24:49.580282+0000 mgr.x (mgr.34652) 24 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:50.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:49 smithi080 bash[35203]: audit 2024-02-17T23:24:48.841473+0000 mon.b (mon.2) 119 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:50.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:49 smithi080 bash[35203]: audit 2024-02-17T23:24:48.842514+0000 mon.a (mon.0) 696 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:50.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:49 smithi080 bash[35203]: audit 2024-02-17T23:24:48.845722+0000 mon.a (mon.0) 697 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"5a9418a4188f\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\", \"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\"], \"memory_usage\": 25469911, \"cpu_percentage\": \"0.13%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776970Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:19:52.239853Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\"], \"last_config\": \"2024-02-17T23:19:45.456404Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:43.777149Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:24:50.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:49 smithi080 bash[35203]: cephadm 2024-02-17T23:24:48.847054+0000 mgr.x (mgr.34652) 22 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2024-02-17T23:24:50.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:49 smithi080 bash[35203]: cephadm 2024-02-17T23:24:48.858402+0000 mgr.x (mgr.34652) 23 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi005 2024-02-17T23:24:50.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:49 smithi080 bash[35203]: cluster 2024-02-17T23:24:49.580282+0000 mgr.x (mgr.34652) 24 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:52.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:51 smithi005 bash[35193]: cluster 2024-02-17T23:24:51.580622+0000 mgr.x (mgr.34652) 25 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:52.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:51 smithi005 bash[38535]: cluster 2024-02-17T23:24:51.580622+0000 mgr.x (mgr.34652) 25 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:52.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:51 smithi080 bash[35203]: cluster 2024-02-17T23:24:51.580622+0000 mgr.x (mgr.34652) 25 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:53 smithi005 bash[35193]: cluster 2024-02-17T23:24:53.581304+0000 mgr.x (mgr.34652) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:54.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:53 smithi005 bash[38535]: cluster 2024-02-17T23:24:53.581304+0000 mgr.x (mgr.34652) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:53 smithi080 bash[35203]: cluster 2024-02-17T23:24:53.581304+0000 mgr.x (mgr.34652) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:56.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:55 smithi005 bash[35193]: cluster 2024-02-17T23:24:55.581698+0000 mgr.x (mgr.34652) 27 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:56.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:55 smithi005 bash[38535]: cluster 2024-02-17T23:24:55.581698+0000 mgr.x (mgr.34652) 27 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:56.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:55 smithi080 bash[35203]: cluster 2024-02-17T23:24:55.581698+0000 mgr.x (mgr.34652) 27 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:57.126 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:56 smithi005 systemd[1]: Stopping Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:24:57.126 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:56 smithi005 bash[50425]: ts=2024-02-17T23:24:56.872Z caller=main.go:594 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-17T23:24:57.582 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:57 smithi005 podman[57571]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager.a 2024-02-17T23:24:57.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:57 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-17T23:24:57.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:57 smithi005 systemd[1]: Stopped Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:24:57.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:57 smithi005 systemd[1]: Starting Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:24:57.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:57 smithi005 podman[57613]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager.a" found: no such container 2024-02-17T23:24:57.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:57 smithi005 systemd[1]: Started Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:24:57.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:57 smithi005 bash[35193]: cluster 2024-02-17T23:24:57.582178+0000 mgr.x (mgr.34652) 28 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:57.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:57 smithi005 bash[38535]: cluster 2024-02-17T23:24:57.582178+0000 mgr.x (mgr.34652) 28 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:57.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:57 smithi005 bash[35193]: audit 2024-02-17T23:24:57.649323+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:57.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:57 smithi005 bash[35193]: audit 2024-02-17T23:24:57.650124+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:57.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:57 smithi005 bash[38535]: audit 2024-02-17T23:24:57.649323+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:57.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:57 smithi005 bash[38535]: audit 2024-02-17T23:24:57.650124+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:57.942 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:57 smithi080 bash[35203]: cluster 2024-02-17T23:24:57.582178+0000 mgr.x (mgr.34652) 28 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:24:57.943 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:57 smithi080 bash[35203]: audit 2024-02-17T23:24:57.649323+0000 mon.b (mon.2) 120 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:57.943 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:57 smithi080 bash[35203]: audit 2024-02-17T23:24:57.650124+0000 mon.a (mon.0) 698 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:24:58.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[57630]: ts=2024-02-17T23:24:58.205Z caller=main.go:245 level=info msg="Starting Alertmanager" version="(version=0.26.0, branch=HEAD, revision=d7b4f0c7322e7151d6e3b1e31cbc15361e295d8d)" 2024-02-17T23:24:58.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[57630]: ts=2024-02-17T23:24:58.205Z caller=main.go:246 level=info build_context="(go=go1.20.7, platform=linux/amd64, user=root@df8d7debeef4, date=20230824-11:11:58, tags=netgo)" 2024-02-17T23:24:58.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[57630]: ts=2024-02-17T23:24:58.206Z caller=cluster.go:186 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.5 port=9094 2024-02-17T23:24:58.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[57630]: ts=2024-02-17T23:24:58.207Z caller=cluster.go:683 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-17T23:24:58.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[57630]: ts=2024-02-17T23:24:58.230Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-17T23:24:58.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[57630]: ts=2024-02-17T23:24:58.230Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-17T23:24:58.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[57630]: ts=2024-02-17T23:24:58.233Z caller=tls_config.go:274 level=info msg="Listening on" address=[::]:9093 2024-02-17T23:24:58.627 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[57630]: ts=2024-02-17T23:24:58.233Z caller=tls_config.go:277 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-02-17T23:24:59.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[38535]: audit 2024-02-17T23:24:57.653645+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:24:59.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[38535]: cephadm 2024-02-17T23:24:57.654613+0000 mgr.x (mgr.34652) 29 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-17T23:24:59.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[38535]: audit 2024-02-17T23:24:57.654918+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:24:59.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[38535]: audit 2024-02-17T23:24:57.660921+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:24:59.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[38535]: audit 2024-02-17T23:24:57.661620+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:59.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[38535]: cephadm 2024-02-17T23:24:57.662264+0000 mgr.x (mgr.34652) 30 : cephadm [INF] Reconfiguring daemon mon.b on smithi080 2024-02-17T23:24:59.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[38535]: audit 2024-02-17T23:24:57.662842+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-17T23:24:59.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[35193]: audit 2024-02-17T23:24:57.653645+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:24:59.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[35193]: cephadm 2024-02-17T23:24:57.654613+0000 mgr.x (mgr.34652) 29 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-17T23:24:59.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[35193]: audit 2024-02-17T23:24:57.654918+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:24:59.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[35193]: audit 2024-02-17T23:24:57.660921+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:24:59.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[35193]: audit 2024-02-17T23:24:57.661620+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:59.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[35193]: cephadm 2024-02-17T23:24:57.662264+0000 mgr.x (mgr.34652) 30 : cephadm [INF] Reconfiguring daemon mon.b on smithi080 2024-02-17T23:24:59.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:58 smithi005 bash[35193]: audit 2024-02-17T23:24:57.662842+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-17T23:24:59.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:58 smithi080 bash[35203]: audit 2024-02-17T23:24:57.653645+0000 mon.a (mon.0) 699 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"bb165dd1d19c\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 301255884, \"cpu_percentage\": \"3.63%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776512Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:13:49.754962Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:44.401384Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:24:59.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:58 smithi080 bash[35203]: cephadm 2024-02-17T23:24:57.654613+0000 mgr.x (mgr.34652) 29 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-17T23:24:59.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:58 smithi080 bash[35203]: audit 2024-02-17T23:24:57.654918+0000 mon.b (mon.2) 121 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:24:59.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:58 smithi080 bash[35203]: audit 2024-02-17T23:24:57.660921+0000 mon.b (mon.2) 122 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:24:59.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:58 smithi080 bash[35203]: audit 2024-02-17T23:24:57.661620+0000 mon.b (mon.2) 123 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:24:59.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:58 smithi080 bash[35203]: cephadm 2024-02-17T23:24:57.662264+0000 mgr.x (mgr.34652) 30 : cephadm [INF] Reconfiguring daemon mon.b on smithi080 2024-02-17T23:24:59.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:58 smithi080 bash[35203]: audit 2024-02-17T23:24:57.662842+0000 mon.b (mon.2) 124 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-17T23:25:00.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[38535]: audit 2024-02-17T23:24:59.273938+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:00.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[35193]: audit 2024-02-17T23:24:59.273938+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:00.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[38535]: audit 2024-02-17T23:24:59.274788+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:00.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[35193]: audit 2024-02-17T23:24:59.274788+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:00.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[35193]: audit 2024-02-17T23:24:59.278305+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:25:00.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[35193]: cephadm 2024-02-17T23:24:59.279509+0000 mgr.x (mgr.34652) 31 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-17T23:25:00.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[35193]: cephadm 2024-02-17T23:24:59.286707+0000 mgr.x (mgr.34652) 32 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi080 2024-02-17T23:25:00.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[35193]: cluster 2024-02-17T23:24:59.582743+0000 mgr.x (mgr.34652) 33 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:00.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[38535]: audit 2024-02-17T23:24:59.278305+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:25:00.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[38535]: cephadm 2024-02-17T23:24:59.279509+0000 mgr.x (mgr.34652) 31 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-17T23:25:00.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[38535]: cephadm 2024-02-17T23:24:59.286707+0000 mgr.x (mgr.34652) 32 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi080 2024-02-17T23:25:00.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:24:59 smithi005 bash[38535]: cluster 2024-02-17T23:24:59.582743+0000 mgr.x (mgr.34652) 33 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:59 smithi080 bash[35203]: audit 2024-02-17T23:24:59.273938+0000 mon.b (mon.2) 125 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:00.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:59 smithi080 bash[35203]: audit 2024-02-17T23:24:59.274788+0000 mon.a (mon.0) 700 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:00.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:59 smithi080 bash[35203]: audit 2024-02-17T23:24:59.278305+0000 mon.a (mon.0) 701 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"8f923fa11fa3\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 26843545, \"cpu_percentage\": \"0.21%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120046Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:19:56.199355Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:19:51.410723Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:24:45.120338Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:25:00.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:59 smithi080 bash[35203]: cephadm 2024-02-17T23:24:59.279509+0000 mgr.x (mgr.34652) 31 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2024-02-17T23:25:00.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:59 smithi080 bash[35203]: cephadm 2024-02-17T23:24:59.286707+0000 mgr.x (mgr.34652) 32 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi080 2024-02-17T23:25:00.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:24:59 smithi080 bash[35203]: cluster 2024-02-17T23:24:59.582743+0000 mgr.x (mgr.34652) 33 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:00.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:25:00 smithi005 bash[57630]: ts=2024-02-17T23:25:00.208Z caller=cluster.go:708 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000283138s 2024-02-17T23:25:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:01 smithi005 bash[35193]: cluster 2024-02-17T23:25:01.583051+0000 mgr.x (mgr.34652) 34 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:02.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:01 smithi005 bash[38535]: cluster 2024-02-17T23:25:01.583051+0000 mgr.x (mgr.34652) 34 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:02.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:01 smithi080 bash[35203]: cluster 2024-02-17T23:25:01.583051+0000 mgr.x (mgr.34652) 34 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:02.334 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:25:02.962 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:25:02.962 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 starting - - - - 2024-02-17T23:25:02.962 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (5m) 17s ago 5m 28.9M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:25:02.962 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 running (49s) 17s ago 9m 415M - 16.2.14-548-g81bd20d6 823b921721f5 8c3856f00a71 2024-02-17T23:25:02.962 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 running (11m) 19s ago 11m 287M - 15.2.0 204a01f9b0b6 bb165dd1d19c 2024-02-17T23:25:02.962 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (11m) 19s ago 11m 78.1M 2048M 15.2.0 204a01f9b0b6 88528bd095e9 2024-02-17T23:25:02.962 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (9m) 17s ago 9m 87.2M 2048M 15.2.0 204a01f9b0b6 627dfcd31839 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (9m) 19s ago 9m 90.2M 2048M 15.2.0 204a01f9b0b6 a3ec149a5abb 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (5m) 19s ago 6m 12.0M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (5m) 17s ago 6m 13.7M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (8m) 19s ago 9m 45.7M 4096M 15.2.0 204a01f9b0b6 e7811399e7c1 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (8m) 19s ago 8m 42.1M 4096M 15.2.0 204a01f9b0b6 61f8f838512a 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (8m) 19s ago 8m 43.3M 4096M 15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (7m) 19s ago 7m 43.0M 4096M 15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (7m) 17s ago 7m 44.0M 4096M 15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (7m) 17s ago 7m 41.0M 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (6m) 17s ago 7m 40.6M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (6m) 17s ago 6m 43.9M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (5m) 17s ago 6m 25.5M - 2.49.1 2a72b385beaf 8f923fa11fa3 2024-02-17T23:25:02.963 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (4m) 19s ago 4m 35.7M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:25:02.964 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (4m) 17s ago 4m 37.2M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:25:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:02 smithi005 bash[35193]: audit 2024-02-17T23:25:02.321275+0000 mgr.x (mgr.34652) 35 : audit [DBG] from='client.24733 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:03.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:02 smithi005 bash[38535]: audit 2024-02-17T23:25:02.321275+0000 mgr.x (mgr.34652) 35 : audit [DBG] from='client.24733 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:03.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:02 smithi080 bash[35203]: audit 2024-02-17T23:25:02.321275+0000 mgr.x (mgr.34652) 35 : audit [DBG] from='client.24733 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:03.344 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 1 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:25:03.345 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:25:03.346 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 14, 2024-02-17T23:25:03.346 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 1 2024-02-17T23:25:03.346 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:25:03.346 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:25:03.663 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:25:03.663 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1", 2024-02-17T23:25:03.663 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:25:03.663 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:25:03.663 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-02-17T23:25:03.663 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "", 2024-02-17T23:25:03.663 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "", 2024-02-17T23:25:03.663 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:25:03.663 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:25:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.637241+0000 mgr.x (mgr.34652) 36 : audit [DBG] from='client.14829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.950174+0000 mgr.x (mgr.34652) 37 : audit [DBG] from='client.14835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.951884+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.952249+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.952484+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.952718+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.952946+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.953169+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.954686+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.954919+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.955143+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.955350+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:02.955595+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: audit 2024-02-17T23:25:03.343526+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.5:0/1079734110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[35193]: cluster 2024-02-17T23:25:03.583622+0000 mgr.x (mgr.34652) 38 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.637241+0000 mgr.x (mgr.34652) 36 : audit [DBG] from='client.14829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.950174+0000 mgr.x (mgr.34652) 37 : audit [DBG] from='client.14835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.951884+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.952249+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.952484+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.952718+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.952946+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.953169+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.954686+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.954919+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.955143+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.955350+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:02.955595+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: audit 2024-02-17T23:25:03.343526+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.5:0/1079734110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:25:04.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:03 smithi005 bash[38535]: cluster 2024-02-17T23:25:03.583622+0000 mgr.x (mgr.34652) 38 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:04.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.637241+0000 mgr.x (mgr.34652) 36 : audit [DBG] from='client.14829 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.950174+0000 mgr.x (mgr.34652) 37 : audit [DBG] from='client.14835 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.951884+0000 mon.b (mon.2) 126 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.952249+0000 mon.b (mon.2) 127 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.952484+0000 mon.b (mon.2) 128 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.952718+0000 mon.b (mon.2) 129 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.952946+0000 mon.b (mon.2) 130 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.953169+0000 mon.b (mon.2) 131 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.954686+0000 mon.b (mon.2) 132 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.954919+0000 mon.b (mon.2) 133 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.955143+0000 mon.b (mon.2) 134 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.955350+0000 mon.b (mon.2) 135 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:02.955595+0000 mon.b (mon.2) 136 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: audit 2024-02-17T23:25:03.343526+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.5:0/1079734110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:25:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:03 smithi080 bash[35203]: cluster 2024-02-17T23:25:03.583622+0000 mgr.x (mgr.34652) 38 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:05.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:04 smithi005 bash[35193]: audit 2024-02-17T23:25:03.661498+0000 mgr.x (mgr.34652) 39 : audit [DBG] from='client.14847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:05.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:04 smithi005 bash[38535]: audit 2024-02-17T23:25:03.661498+0000 mgr.x (mgr.34652) 39 : audit [DBG] from='client.14847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:05.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:04 smithi080 bash[35203]: audit 2024-02-17T23:25:03.661498+0000 mgr.x (mgr.34652) 39 : audit [DBG] from='client.14847 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:06.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:05 smithi005 bash[35193]: cluster 2024-02-17T23:25:05.584000+0000 mgr.x (mgr.34652) 40 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:06.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:05 smithi005 bash[38535]: cluster 2024-02-17T23:25:05.584000+0000 mgr.x (mgr.34652) 40 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:06.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:05 smithi080 bash[35203]: cluster 2024-02-17T23:25:05.584000+0000 mgr.x (mgr.34652) 40 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:08.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:07 smithi005 bash[35193]: cluster 2024-02-17T23:25:07.584326+0000 mgr.x (mgr.34652) 41 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:08.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:07 smithi005 bash[38535]: cluster 2024-02-17T23:25:07.584326+0000 mgr.x (mgr.34652) 41 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:08.136 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:07 smithi080 bash[35203]: cluster 2024-02-17T23:25:07.584326+0000 mgr.x (mgr.34652) 41 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:08.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:25:08 smithi005 bash[57630]: ts=2024-02-17T23:25:08.210Z caller=cluster.go:700 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.00280337s 2024-02-17T23:25:10.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:09 smithi005 bash[35193]: cluster 2024-02-17T23:25:09.585188+0000 mgr.x (mgr.34652) 42 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:10.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:09 smithi005 bash[38535]: cluster 2024-02-17T23:25:09.585188+0000 mgr.x (mgr.34652) 42 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:10.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[35203]: cluster 2024-02-17T23:25:09.585188+0000 mgr.x (mgr.34652) 42 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:10.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 systemd[1]: Stopping Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:25:10.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.843Z caller=main.go:874 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-17T23:25:10.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.843Z caller=main.go:898 level=info msg="Stopping scrape discovery manager..." 2024-02-17T23:25:10.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.843Z caller=main.go:912 level=info msg="Stopping notify discovery manager..." 2024-02-17T23:25:10.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.843Z caller=manager.go:160 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-17T23:25:10.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.843Z caller=manager.go:170 level=info component="rule manager" msg="Rule manager stopped" 2024-02-17T23:25:10.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.843Z caller=main.go:949 level=info msg="Stopping scrape manager..." 2024-02-17T23:25:10.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.843Z caller=main.go:908 level=info msg="Notify discovery manager stopped" 2024-02-17T23:25:10.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.843Z caller=main.go:894 level=info msg="Scrape discovery manager stopped" 2024-02-17T23:25:10.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.843Z caller=main.go:941 level=info msg="Scrape manager stopped" 2024-02-17T23:25:10.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.844Z caller=notifier.go:604 level=info component=notifier msg="Stopping notification manager..." 2024-02-17T23:25:10.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.844Z caller=main.go:1171 level=info msg="Notifier manager stopped" 2024-02-17T23:25:10.141 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:09 smithi080 bash[46029]: ts=2024-02-17T23:25:09.844Z caller=main.go:1183 level=info msg="See you next time!" 2024-02-17T23:25:10.520 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:10 smithi080 podman[50562]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus.a 2024-02-17T23:25:10.887 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:10 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@prometheus.a.service: Succeeded. 2024-02-17T23:25:10.888 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:10 smithi080 systemd[1]: Stopped Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:25:10.888 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:10 smithi080 systemd[1]: Starting Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:25:10.888 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:10 smithi080 podman[50604]: Error: no container with ID or name "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus.a" found: no such container 2024-02-17T23:25:10.888 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:10 smithi080 systemd[1]: Started Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:25:10.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.585318+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:10.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.586068+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:10.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.589438+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:10.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.593134+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:25:10.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.593475+0000 mgr.x (mgr.34652) 43 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:25:10.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.594306+0000 mon.b (mon.2) 139 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005.front.sepia.ceph.com:9093"}]: dispatch 2024-02-17T23:25:10.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.594556+0000 mgr.x (mgr.34652) 44 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005.front.sepia.ceph.com:9093"}]: dispatch 2024-02-17T23:25:10.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.594795+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi005.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-17T23:25:10.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.595147+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi005.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-17T23:25:10.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.598534+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi005.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-02-17T23:25:10.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.603954+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:25:10.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.608470+0000 mon.b (mon.2) 142 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi080.front.sepia.ceph.com:9095"}]: dispatch 2024-02-17T23:25:10.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.609163+0000 mon.b (mon.2) 143 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-17T23:25:10.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.609642+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-17T23:25:10.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:10 smithi080 bash[35203]: audit 2024-02-17T23:25:10.613351+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-02-17T23:25:11.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.585318+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:11.028 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.585318+0000 mon.b (mon.2) 137 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:11.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.586068+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:11.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.589438+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:11.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.593134+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:25:11.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.593475+0000 mgr.x (mgr.34652) 43 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:25:11.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.594306+0000 mon.b (mon.2) 139 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005.front.sepia.ceph.com:9093"}]: dispatch 2024-02-17T23:25:11.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.594556+0000 mgr.x (mgr.34652) 44 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005.front.sepia.ceph.com:9093"}]: dispatch 2024-02-17T23:25:11.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.586068+0000 mon.a (mon.0) 702 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:11.030 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.594795+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi005.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-17T23:25:11.030 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.595147+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi005.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-17T23:25:11.030 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.598534+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi005.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-02-17T23:25:11.030 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.603954+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:25:11.030 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.608470+0000 mon.b (mon.2) 142 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi080.front.sepia.ceph.com:9095"}]: dispatch 2024-02-17T23:25:11.030 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.609163+0000 mon.b (mon.2) 143 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-17T23:25:11.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.609642+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-17T23:25:11.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[35193]: audit 2024-02-17T23:25:10.613351+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-02-17T23:25:11.031 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.589438+0000 mon.a (mon.0) 703 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:14:53.184926Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:11.031 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.593134+0000 mon.b (mon.2) 138 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:25:11.031 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.593475+0000 mgr.x (mgr.34652) 43 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:25:11.031 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.594306+0000 mon.b (mon.2) 139 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005.front.sepia.ceph.com:9093"}]: dispatch 2024-02-17T23:25:11.031 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.594556+0000 mgr.x (mgr.34652) 44 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi005.front.sepia.ceph.com:9093"}]: dispatch 2024-02-17T23:25:11.031 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.594795+0000 mon.b (mon.2) 140 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi005.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-17T23:25:11.031 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.595147+0000 mon.a (mon.0) 704 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi005.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]: dispatch 2024-02-17T23:25:11.031 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.598534+0000 mon.a (mon.0) 705 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi005.front.sepia.ceph.com:9093","who":"mgr","name":"mgr/dashboard/ALERTMANAGER_API_HOST"}]': finished 2024-02-17T23:25:11.032 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.603954+0000 mon.b (mon.2) 141 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:25:11.032 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.608470+0000 mon.b (mon.2) 142 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi080.front.sepia.ceph.com:9095"}]: dispatch 2024-02-17T23:25:11.032 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.609163+0000 mon.b (mon.2) 143 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-17T23:25:11.032 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.609642+0000 mon.a (mon.0) 706 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]: dispatch 2024-02-17T23:25:11.032 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:10 smithi005 bash[38535]: audit 2024-02-17T23:25:10.613351+0000 mon.a (mon.0) 707 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config set","value":"http://smithi080.front.sepia.ceph.com:9095","who":"mgr","name":"mgr/dashboard/PROMETHEUS_API_HOST"}]': finished 2024-02-17T23:25:11.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.096Z caller=main.go:544 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-02-17T23:25:11.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.096Z caller=main.go:588 level=info msg="Starting Prometheus Server" mode=server version="(version=2.49.1, branch=HEAD, revision=43e14844a33b65e2a396e3944272af8b3a494071)" 2024-02-17T23:25:11.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.096Z caller=main.go:593 level=info build_context="(go=go1.21.6, platform=linux/amd64, user=root@6d5f4c649d25, date=20240115-16:58:43, tags=netgo,builtinassets,stringlabels)" 2024-02-17T23:25:11.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.096Z caller=main.go:594 level=info host_details="(Linux 4.18.0-539.el8.x86_64 #1 SMP Mon Feb 5 18:34:56 UTC 2024 x86_64 smithi080 (none))" 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.096Z caller=main.go:595 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.096Z caller=main.go:596 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.097Z caller=web.go:565 level=info component=web msg="Start listening for connections" address=:9095 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.098Z caller=main.go:1039 level=info msg="Starting TSDB ..." 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.099Z caller=tls_config.go:274 level=info component=web msg="Listening on" address=[::]:9095 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.099Z caller=tls_config.go:277 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.101Z caller=head.go:606 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.101Z caller=head.go:687 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.747µs 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.101Z caller=head.go:695 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.101Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.111Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.111Z caller=head.go:766 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.111Z caller=head.go:803 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=24.958µs wal_replay_duration=9.945879ms wbl_replay_duration=144ns total_replay_duration=9.992022ms 2024-02-17T23:25:11.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.113Z caller=main.go:1060 level=info fs_type=XFS_SUPER_MAGIC 2024-02-17T23:25:11.642 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.113Z caller=main.go:1063 level=info msg="TSDB started" 2024-02-17T23:25:11.642 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.113Z caller=main.go:1245 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-17T23:25:11.642 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.125Z caller=main.go:1282 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=12.39236ms db_storage=1.013µs remote_storage=1.041µs web_handler=435ns query_engine=576ns scrape=377.515µs scrape_sd=23.693µs notify=16.665µs notify_sd=5.525µs rules=11.765247ms tracing=4.844µs 2024-02-17T23:25:11.642 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.125Z caller=main.go:1024 level=info msg="Server is ready to receive web requests." 2024-02-17T23:25:11.642 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[50621]: ts=2024-02-17T23:25:11.125Z caller=manager.go:146 level=info component="rule manager" msg="Starting rule manager..." 2024-02-17T23:25:11.966 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:11 smithi005 bash[35193]: audit 2024-02-17T23:25:10.604359+0000 mgr.x (mgr.34652) 45 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:25:11.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:11 smithi005 bash[35193]: audit 2024-02-17T23:25:10.608861+0000 mgr.x (mgr.34652) 46 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi080.front.sepia.ceph.com:9095"}]: dispatch 2024-02-17T23:25:11.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:11 smithi005 bash[35193]: cephadm 2024-02-17T23:25:10.615611+0000 mgr.x (mgr.34652) 47 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-17T23:25:11.967 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:11 smithi005 bash[35193]: cluster 2024-02-17T23:25:11.585520+0000 mgr.x (mgr.34652) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:11.967 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:11 smithi005 bash[38535]: audit 2024-02-17T23:25:10.604359+0000 mgr.x (mgr.34652) 45 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:25:11.967 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:11 smithi005 bash[38535]: audit 2024-02-17T23:25:10.608861+0000 mgr.x (mgr.34652) 46 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi080.front.sepia.ceph.com:9095"}]: dispatch 2024-02-17T23:25:11.967 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:11 smithi005 bash[38535]: cephadm 2024-02-17T23:25:10.615611+0000 mgr.x (mgr.34652) 47 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-17T23:25:11.967 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:11 smithi005 bash[38535]: cluster 2024-02-17T23:25:11.585520+0000 mgr.x (mgr.34652) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:12.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[35203]: audit 2024-02-17T23:25:10.604359+0000 mgr.x (mgr.34652) 45 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:25:12.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[35203]: audit 2024-02-17T23:25:10.608861+0000 mgr.x (mgr.34652) 46 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi080.front.sepia.ceph.com:9095"}]: dispatch 2024-02-17T23:25:12.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[35203]: cephadm 2024-02-17T23:25:10.615611+0000 mgr.x (mgr.34652) 47 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1 2024-02-17T23:25:12.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:11 smithi080 bash[35203]: cluster 2024-02-17T23:25:11.585520+0000 mgr.x (mgr.34652) 48 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[35193]: audit 2024-02-17T23:25:12.818483+0000 mon.b (mon.2) 144 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"target_version\": \"16.2.14-548-g81bd20d6\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-17T23:25:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[35193]: audit 2024-02-17T23:25:12.819147+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"target_version\": \"16.2.14-548-g81bd20d6\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-17T23:25:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[35193]: audit 2024-02-17T23:25:12.822289+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"target_version\": \"16.2.14-548-g81bd20d6\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-17T23:25:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[35193]: audit 2024-02-17T23:25:12.824037+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[35193]: audit 2024-02-17T23:25:12.825136+0000 mon.b (mon.2) 146 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[35193]: audit 2024-02-17T23:25:12.825485+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:13.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[35193]: audit 2024-02-17T23:25:12.828939+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-17T23:25:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[38535]: audit 2024-02-17T23:25:12.818483+0000 mon.b (mon.2) 144 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"target_version\": \"16.2.14-548-g81bd20d6\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-17T23:25:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[38535]: audit 2024-02-17T23:25:12.819147+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"target_version\": \"16.2.14-548-g81bd20d6\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-17T23:25:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[38535]: audit 2024-02-17T23:25:12.822289+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"target_version\": \"16.2.14-548-g81bd20d6\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-17T23:25:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[38535]: audit 2024-02-17T23:25:12.824037+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[38535]: audit 2024-02-17T23:25:12.825136+0000 mon.b (mon.2) 146 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[38535]: audit 2024-02-17T23:25:12.825485+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:13.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:12 smithi005 bash[38535]: audit 2024-02-17T23:25:12.828939+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-17T23:25:13.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:12 smithi080 bash[35203]: audit 2024-02-17T23:25:12.818483+0000 mon.b (mon.2) 144 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"target_version\": \"16.2.14-548-g81bd20d6\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-17T23:25:13.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:12 smithi080 bash[35203]: audit 2024-02-17T23:25:12.819147+0000 mon.a (mon.0) 708 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"target_version\": \"16.2.14-548-g81bd20d6\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]: dispatch 2024-02-17T23:25:13.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:12 smithi080 bash[35203]: audit 2024-02-17T23:25:12.822289+0000 mon.a (mon.0) 709 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/upgrade_state","val":"{\"target_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"progress_id\": \"9081479c-76df-4d88-b8d6-a4fd3f7029b2\", \"target_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"target_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"target_version\": \"16.2.14-548-g81bd20d6\", \"fs_original_max_mds\": null, \"fs_original_allow_standby_replay\": null, \"error\": null, \"paused\": false, \"daemon_types\": null, \"hosts\": null, \"services\": null, \"total_count\": null, \"remaining_count\": null}"}]': finished 2024-02-17T23:25:13.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:12 smithi080 bash[35203]: audit 2024-02-17T23:25:12.824037+0000 mon.b (mon.2) 145 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:13.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:12 smithi080 bash[35203]: audit 2024-02-17T23:25:12.825136+0000 mon.b (mon.2) 146 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:13.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:12 smithi080 bash[35203]: audit 2024-02-17T23:25:12.825485+0000 mon.a (mon.0) 710 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:13.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:12 smithi080 bash[35203]: audit 2024-02-17T23:25:12.828939+0000 mon.a (mon.0) 711 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]': finished 2024-02-17T23:25:14.025 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:13 smithi005 bash[35193]: cephadm 2024-02-17T23:25:12.823001+0000 mgr.x (mgr.34652) 49 : cephadm [INF] Upgrade: Target is version 16.2.14-548-g81bd20d6 (pacific) 2024-02-17T23:25:14.026 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:13 smithi005 bash[35193]: cephadm 2024-02-17T23:25:12.823096+0000 mgr.x (mgr.34652) 50 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9'] 2024-02-17T23:25:14.026 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:13 smithi005 bash[35193]: cephadm 2024-02-17T23:25:12.832463+0000 mgr.x (mgr.34652) 51 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:14.026 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:13 smithi005 bash[35193]: cephadm 2024-02-17T23:25:12.833064+0000 mgr.x (mgr.34652) 52 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:14.026 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:13 smithi005 bash[35193]: cluster 2024-02-17T23:25:13.586186+0000 mgr.x (mgr.34652) 53 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:14.026 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:13 smithi005 bash[38535]: cephadm 2024-02-17T23:25:12.823001+0000 mgr.x (mgr.34652) 49 : cephadm [INF] Upgrade: Target is version 16.2.14-548-g81bd20d6 (pacific) 2024-02-17T23:25:14.026 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:13 smithi005 bash[38535]: cephadm 2024-02-17T23:25:12.823096+0000 mgr.x (mgr.34652) 50 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9'] 2024-02-17T23:25:14.026 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:13 smithi005 bash[38535]: cephadm 2024-02-17T23:25:12.832463+0000 mgr.x (mgr.34652) 51 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:14.026 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:13 smithi005 bash[38535]: cephadm 2024-02-17T23:25:12.833064+0000 mgr.x (mgr.34652) 52 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:14.026 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:13 smithi005 bash[38535]: cluster 2024-02-17T23:25:13.586186+0000 mgr.x (mgr.34652) 53 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:13 smithi080 bash[35203]: cephadm 2024-02-17T23:25:12.823001+0000 mgr.x (mgr.34652) 49 : cephadm [INF] Upgrade: Target is version 16.2.14-548-g81bd20d6 (pacific) 2024-02-17T23:25:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:13 smithi080 bash[35203]: cephadm 2024-02-17T23:25:12.823096+0000 mgr.x (mgr.34652) 50 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9, digests ['quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9'] 2024-02-17T23:25:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:13 smithi080 bash[35203]: cephadm 2024-02-17T23:25:12.832463+0000 mgr.x (mgr.34652) 51 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:13 smithi080 bash[35203]: cephadm 2024-02-17T23:25:12.833064+0000 mgr.x (mgr.34652) 52 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:14.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:13 smithi080 bash[35203]: cluster 2024-02-17T23:25:13.586186+0000 mgr.x (mgr.34652) 53 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:14 smithi080 bash[35203]: cephadm 2024-02-17T23:25:14.487667+0000 mgr.x (mgr.34652) 54 : cephadm [INF] Upgrade: Updating mgr.y 2024-02-17T23:25:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:14 smithi080 bash[35203]: audit 2024-02-17T23:25:14.488120+0000 mon.b (mon.2) 147 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.y"}]: dispatch 2024-02-17T23:25:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:14 smithi080 bash[35203]: audit 2024-02-17T23:25:14.488906+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.y"}]: dispatch 2024-02-17T23:25:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:14 smithi080 bash[35203]: audit 2024-02-17T23:25:14.493270+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.y"}]': finished 2024-02-17T23:25:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:14 smithi080 bash[35203]: audit 2024-02-17T23:25:14.494239+0000 mon.b (mon.2) 148 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:14 smithi080 bash[35203]: audit 2024-02-17T23:25:14.494627+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:14 smithi080 bash[35203]: audit 2024-02-17T23:25:14.495477+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:25:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:14 smithi080 bash[35203]: audit 2024-02-17T23:25:14.496286+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:25:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:14 smithi080 bash[35203]: cephadm 2024-02-17T23:25:14.496944+0000 mgr.x (mgr.34652) 55 : cephadm [INF] Deploying daemon mgr.y on smithi005 2024-02-17T23:25:15.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:14 smithi080 bash[35203]: audit 2024-02-17T23:25:14.497465+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-17T23:25:15.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[35193]: cephadm 2024-02-17T23:25:14.487667+0000 mgr.x (mgr.34652) 54 : cephadm [INF] Upgrade: Updating mgr.y 2024-02-17T23:25:15.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[35193]: audit 2024-02-17T23:25:14.488120+0000 mon.b (mon.2) 147 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.y"}]: dispatch 2024-02-17T23:25:15.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[35193]: audit 2024-02-17T23:25:14.488906+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.y"}]: dispatch 2024-02-17T23:25:15.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[35193]: audit 2024-02-17T23:25:14.493270+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.y"}]': finished 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[35193]: audit 2024-02-17T23:25:14.494239+0000 mon.b (mon.2) 148 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[35193]: audit 2024-02-17T23:25:14.494627+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[35193]: audit 2024-02-17T23:25:14.495477+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[35193]: audit 2024-02-17T23:25:14.496286+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[35193]: cephadm 2024-02-17T23:25:14.496944+0000 mgr.x (mgr.34652) 55 : cephadm [INF] Deploying daemon mgr.y on smithi005 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[35193]: audit 2024-02-17T23:25:14.497465+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[38535]: cephadm 2024-02-17T23:25:14.487667+0000 mgr.x (mgr.34652) 54 : cephadm [INF] Upgrade: Updating mgr.y 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[38535]: audit 2024-02-17T23:25:14.488120+0000 mon.b (mon.2) 147 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.y"}]: dispatch 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[38535]: audit 2024-02-17T23:25:14.488906+0000 mon.a (mon.0) 712 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.y"}]: dispatch 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[38535]: audit 2024-02-17T23:25:14.493270+0000 mon.a (mon.0) 713 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr.y"}]': finished 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[38535]: audit 2024-02-17T23:25:14.494239+0000 mon.b (mon.2) 148 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:15.149 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[38535]: audit 2024-02-17T23:25:14.494627+0000 mon.a (mon.0) 714 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:15.150 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[38535]: audit 2024-02-17T23:25:14.495477+0000 mon.b (mon.2) 149 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:25:15.150 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[38535]: audit 2024-02-17T23:25:14.496286+0000 mon.b (mon.2) 150 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:25:15.150 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[38535]: cephadm 2024-02-17T23:25:14.496944+0000 mgr.x (mgr.34652) 55 : cephadm [INF] Deploying daemon mgr.y on smithi005 2024-02-17T23:25:15.150 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:14 smithi005 bash[38535]: audit 2024-02-17T23:25:14.497465+0000 mon.b (mon.2) 151 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-17T23:25:16.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:15 smithi080 bash[35203]: cluster 2024-02-17T23:25:15.586717+0000 mgr.x (mgr.34652) 56 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:16.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:15 smithi005 bash[35193]: cluster 2024-02-17T23:25:15.586717+0000 mgr.x (mgr.34652) 56 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:16.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:15 smithi005 bash[38535]: cluster 2024-02-17T23:25:15.586717+0000 mgr.x (mgr.34652) 56 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:16.377 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:16 smithi005 systemd[1]: Stopping Ceph mgr.y for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:25:18.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:17 smithi005 bash[35193]: cluster 2024-02-17T23:25:17.587232+0000 mgr.x (mgr.34652) 57 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:18.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:17 smithi005 bash[38535]: cluster 2024-02-17T23:25:17.587232+0000 mgr.x (mgr.34652) 57 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:18.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:17 smithi080 bash[35203]: cluster 2024-02-17T23:25:17.587232+0000 mgr.x (mgr.34652) 57 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:20.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:19 smithi005 bash[35193]: cluster 2024-02-17T23:25:19.587861+0000 mgr.x (mgr.34652) 58 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:20.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:19 smithi005 bash[38535]: cluster 2024-02-17T23:25:19.587861+0000 mgr.x (mgr.34652) 58 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:20.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:19 smithi080 bash[35203]: cluster 2024-02-17T23:25:19.587861+0000 mgr.x (mgr.34652) 58 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:21 smithi005 bash[35193]: cluster 2024-02-17T23:25:21.588222+0000 mgr.x (mgr.34652) 59 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:22.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:21 smithi005 bash[38535]: cluster 2024-02-17T23:25:21.588222+0000 mgr.x (mgr.34652) 59 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:22.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:21 smithi080 bash[35203]: cluster 2024-02-17T23:25:21.588222+0000 mgr.x (mgr.34652) 59 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:24.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:23 smithi005 bash[35193]: cluster 2024-02-17T23:25:23.589090+0000 mgr.x (mgr.34652) 60 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:24.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:23 smithi005 bash[38535]: cluster 2024-02-17T23:25:23.589090+0000 mgr.x (mgr.34652) 60 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:24.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:23 smithi080 bash[35203]: cluster 2024-02-17T23:25:23.589090+0000 mgr.x (mgr.34652) 60 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:26.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:25 smithi005 bash[35193]: cluster 2024-02-17T23:25:25.589562+0000 mgr.x (mgr.34652) 61 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:26.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:25 smithi005 bash[38535]: cluster 2024-02-17T23:25:25.589562+0000 mgr.x (mgr.34652) 61 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:26.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:25 smithi080 bash[35203]: cluster 2024-02-17T23:25:25.589562+0000 mgr.x (mgr.34652) 61 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:26.626 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:26 smithi005 bash[58135]: time="2024-02-17T23:25:26Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.y in 10 seconds, resorting to SIGKILL" 2024-02-17T23:25:27.626 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[58135]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.y 2024-02-17T23:25:27.626 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:27 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y.service: Main process exited, code=exited, status=137/n/a 2024-02-17T23:25:27.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[35193]: cluster 2024-02-17T23:25:27.589932+0000 mgr.x (mgr.34652) 62 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:27.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[35193]: audit 2024-02-17T23:25:27.614239+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-17T23:25:27.986 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[35193]: audit 2024-02-17T23:25:27.614563+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[35193]: audit 2024-02-17T23:25:27.614761+0000 mon.b (mon.2) 154 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[35193]: audit 2024-02-17T23:25:27.614762+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[35193]: audit 2024-02-17T23:25:27.614942+0000 mon.b (mon.2) 155 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[35193]: audit 2024-02-17T23:25:27.615422+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[35193]: audit 2024-02-17T23:25:27.615663+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[35193]: audit 2024-02-17T23:25:27.615891+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[38535]: cluster 2024-02-17T23:25:27.589932+0000 mgr.x (mgr.34652) 62 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[38535]: audit 2024-02-17T23:25:27.614239+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[38535]: audit 2024-02-17T23:25:27.614563+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[38535]: audit 2024-02-17T23:25:27.614761+0000 mon.b (mon.2) 154 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[38535]: audit 2024-02-17T23:25:27.614762+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-17T23:25:27.987 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[38535]: audit 2024-02-17T23:25:27.614942+0000 mon.b (mon.2) 155 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:25:27.988 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[38535]: audit 2024-02-17T23:25:27.615422+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:25:27.988 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[38535]: audit 2024-02-17T23:25:27.615663+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-17T23:25:27.988 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:27 smithi005 bash[38535]: audit 2024-02-17T23:25:27.615891+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:25:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:27 smithi080 bash[35203]: cluster 2024-02-17T23:25:27.589932+0000 mgr.x (mgr.34652) 62 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:27 smithi080 bash[35203]: audit 2024-02-17T23:25:27.614239+0000 mon.b (mon.2) 152 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-17T23:25:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:27 smithi080 bash[35203]: audit 2024-02-17T23:25:27.614563+0000 mon.b (mon.2) 153 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:25:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:27 smithi080 bash[35203]: audit 2024-02-17T23:25:27.614761+0000 mon.b (mon.2) 154 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-17T23:25:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:27 smithi080 bash[35203]: audit 2024-02-17T23:25:27.614762+0000 mon.a (mon.0) 715 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1b", "id": [7, 2]}]: dispatch 2024-02-17T23:25:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:27 smithi080 bash[35203]: audit 2024-02-17T23:25:27.614942+0000 mon.b (mon.2) 155 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:25:28.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:27 smithi080 bash[35203]: audit 2024-02-17T23:25:27.615422+0000 mon.a (mon.0) 716 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:25:28.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:27 smithi080 bash[35203]: audit 2024-02-17T23:25:27.615663+0000 mon.a (mon.0) 717 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.9", "id": [1, 2]}]: dispatch 2024-02-17T23:25:28.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:27 smithi080 bash[35203]: audit 2024-02-17T23:25:27.615891+0000 mon.a (mon.0) 718 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:25:28.376 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:27 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y.service: Failed with result 'exit-code'. 2024-02-17T23:25:28.376 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:27 smithi005 systemd[1]: Stopped Ceph mgr.y for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:25:28.376 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:28 smithi005 systemd[1]: Starting Ceph mgr.y for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:25:29.126 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:28.690+0000 7f56692e4700 1 -- 172.21.15.5:0/3407595186 <== mon.1 v2:172.21.15.5:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d4aa2c84e0 con 0x55d4aa29d400 2024-02-17T23:25:29.126 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:28 smithi005 bash[58327]: 5130266792fb9a4076c61d2be821421371bd6638f997e96e454267df38afa63c 2024-02-17T23:25:29.126 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:28 smithi005 systemd[1]: Started Ceph mgr.y for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:25:29.126 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:28.818+0000 7f56798df680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T23:25:29.126 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:28.906+0000 7f56798df680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T23:25:29.625 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:29.316+0000 7f56798df680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T23:25:30.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[35193]: audit 2024-02-17T23:25:28.860116+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[38535]: audit 2024-02-17T23:25:28.860116+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[35193]: audit 2024-02-17T23:25:28.860923+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[38535]: audit 2024-02-17T23:25:28.860923+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[35193]: audit 2024-02-17T23:25:28.864019+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:30.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[35193]: audit 2024-02-17T23:25:28.865122+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:30.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[35193]: audit 2024-02-17T23:25:28.866758+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:30.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[35193]: audit 2024-02-17T23:25:29.106870+0000 mon.b (mon.2) 159 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[38535]: audit 2024-02-17T23:25:28.864019+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:30.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[38535]: audit 2024-02-17T23:25:28.865122+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:30.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[38535]: audit 2024-02-17T23:25:28.866758+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:30.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[38535]: audit 2024-02-17T23:25:29.106870+0000 mon.b (mon.2) 159 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[35193]: audit 2024-02-17T23:25:29.107694+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.133 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[38535]: audit 2024-02-17T23:25:29.107694+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.133 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[38535]: audit 2024-02-17T23:25:29.111788+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:30.133 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[38535]: audit 2024-02-17T23:25:29.112613+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:30.134 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[38535]: cluster 2024-02-17T23:25:29.590671+0000 mgr.x (mgr.34652) 63 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:30.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[35193]: audit 2024-02-17T23:25:29.111788+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:30.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[35193]: audit 2024-02-17T23:25:29.112613+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:30.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:29 smithi005 bash[35193]: cluster 2024-02-17T23:25:29.590671+0000 mgr.x (mgr.34652) 63 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:30.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:29 smithi080 bash[35203]: audit 2024-02-17T23:25:28.860116+0000 mon.b (mon.2) 156 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:29 smithi080 bash[35203]: audit 2024-02-17T23:25:28.860923+0000 mon.a (mon.0) 719 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:29 smithi080 bash[35203]: audit 2024-02-17T23:25:28.864019+0000 mon.a (mon.0) 720 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 81956700, \"cpu_percentage\": \"1.94%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776307Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 94665441, \"cpu_percentage\": \"0.78%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776580Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 47919923, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776641Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 44228935, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776700Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45445283, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776785Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45130711, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776850Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12614369, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.776910Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"service_name\": \"alertmanager\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 37434163, \"cpu_percentage\": \"0.19%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:43.777029Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:30.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:29 smithi080 bash[35203]: audit 2024-02-17T23:25:28.865122+0000 mon.b (mon.2) 157 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:30.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:29 smithi080 bash[35203]: audit 2024-02-17T23:25:28.866758+0000 mon.b (mon.2) 158 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:30.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:29 smithi080 bash[35203]: audit 2024-02-17T23:25:29.106870+0000 mon.b (mon.2) 159 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:29 smithi080 bash[35203]: audit 2024-02-17T23:25:29.107694+0000 mon.a (mon.0) 721 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:30.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:29 smithi080 bash[35203]: audit 2024-02-17T23:25:29.111788+0000 mon.a (mon.0) 722 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 91509227, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119557Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 435159040, \"cpu_percentage\": \"26.06%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.119700Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46210744, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119780Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 43002101, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119846Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 42666557, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119908Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46095400, \"cpu_percentage\": \"0.57%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.119969Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"service_name\": \"prometheus\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14375976, \"cpu_percentage\": \"0.35%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120105Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30345789, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:24:45.120163Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39038484, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:24:45.120221Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:30.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:29 smithi080 bash[35203]: audit 2024-02-17T23:25:29.112613+0000 mon.b (mon.2) 160 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:30.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:29 smithi080 bash[35203]: cluster 2024-02-17T23:25:29.590671+0000 mgr.x (mgr.34652) 63 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:30.446 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:30.134+0000 7f56798df680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T23:25:30.446 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:30.224+0000 7f56798df680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T23:25:30.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:30.444+0000 7f56798df680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T23:25:31.779 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:31 smithi005 bash[35193]: cluster 2024-02-17T23:25:31.591055+0000 mgr.x (mgr.34652) 64 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:31.779 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:31.518+0000 7f56798df680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T23:25:31.779 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:31.670+0000 7f56798df680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:25:31.779 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:31 smithi005 bash[38535]: cluster 2024-02-17T23:25:31.591055+0000 mgr.x (mgr.34652) 64 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:32.075 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:31 smithi080 bash[35203]: cluster 2024-02-17T23:25:31.591055+0000 mgr.x (mgr.34652) 64 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:32.087 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:31.776+0000 7f56798df680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T23:25:32.087 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:31.876+0000 7f56798df680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T23:25:32.375 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:32.084+0000 7f56798df680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T23:25:32.772 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:32.386+0000 7f56798df680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T23:25:32.772 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:32.489+0000 7f56798df680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T23:25:33.578 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:33.273+0000 7f56798df680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T23:25:33.578 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:33.363+0000 7f56798df680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T23:25:33.578 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:33.459+0000 7f56798df680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T23:25:33.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:33 smithi005 bash[35193]: cluster 2024-02-17T23:25:33.591838+0000 mgr.x (mgr.34652) 65 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:33.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:33.645+0000 7f56798df680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T23:25:33.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:33 smithi005 bash[38535]: cluster 2024-02-17T23:25:33.591838+0000 mgr.x (mgr.34652) 65 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:34.025 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:33 smithi080 bash[35203]: cluster 2024-02-17T23:25:33.591838+0000 mgr.x (mgr.34652) 65 : cluster [DBG] pgmap v36: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:34.045 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:25:34.223 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:33.936+0000 7f56798df680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T23:25:34.223 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:34.077+0000 7f56798df680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T23:25:34.497 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:34.221+0000 7f56798df680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:25:34.498 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:34.404+0000 7f56798df680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (36s) 0s ago 6m 16.0M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (6m) 49s ago 6m 28.9M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 running (81s) 49s ago 9m 415M - 16.2.14-548-g81bd20d6 823b921721f5 8c3856f00a71 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (6s) 0s ago 11m 43.4M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (11m) 0s ago 11m 93.2M 2048M 15.2.0 204a01f9b0b6 88528bd095e9 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (10m) 49s ago 10m 87.2M 2048M 15.2.0 204a01f9b0b6 627dfcd31839 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (10m) 0s ago 10m 90.3M 2048M 15.2.0 204a01f9b0b6 a3ec149a5abb 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (6m) 0s ago 6m 12.0M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (6m) 49s ago 6m 13.7M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:25:34.694 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (9m) 0s ago 9m 45.8M 4096M 15.2.0 204a01f9b0b6 e7811399e7c1 2024-02-17T23:25:34.695 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (9m) 0s ago 9m 42.2M 4096M 15.2.0 204a01f9b0b6 61f8f838512a 2024-02-17T23:25:34.695 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (8m) 0s ago 8m 43.4M 4096M 15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:25:34.695 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (8m) 0s ago 8m 43.2M 4096M 15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:25:34.695 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (8m) 49s ago 8m 44.0M 4096M 15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:25:34.695 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (7m) 49s ago 7m 41.0M 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:25:34.695 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (7m) 49s ago 7m 40.6M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:25:34.695 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (7m) 49s ago 7m 43.9M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:25:34.695 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 starting - - - - 2024-02-17T23:25:34.695 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (4m) 0s ago 4m 35.8M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:25:34.695 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (4m) 49s ago 4m 37.2M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:25:34.755 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:25:34.495+0000 7f56798df680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T23:25:34.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:33.943652+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 97737768, \"cpu_percentage\": \"1.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941381Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 45518684, \"cpu_percentage\": \"107.51%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:33.941550Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 94717870, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941631Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48108666, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941703Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44333793, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941795Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45592084, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941865Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45329940, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941934Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12635340, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942002Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.35%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942069Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 37633392, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942136Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:33.942263Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:34.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:33.944428+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 97737768, \"cpu_percentage\": \"1.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941381Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 45518684, \"cpu_percentage\": \"107.51%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:33.941550Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 94717870, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941631Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48108666, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941703Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44333793, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941795Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45592084, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941865Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45329940, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941934Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12635340, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942002Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.35%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942069Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 37633392, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942136Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:33.942263Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:34.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:33.947405+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 97737768, \"cpu_percentage\": \"1.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941381Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 45518684, \"cpu_percentage\": \"107.51%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:33.941550Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 94717870, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941631Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48108666, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941703Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44333793, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941795Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45592084, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941865Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45329940, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941934Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12635340, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942002Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.35%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942069Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 37633392, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942136Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:33.942263Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:34.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.032112+0000 mgr.x (mgr.34652) 66 : audit [DBG] from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:34.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.365501+0000 mgr.x (mgr.34652) 67 : audit [DBG] from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:34.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: cluster 2024-02-17T23:25:34.498778+0000 mon.a (mon.0) 725 : cluster [DBG] Standby manager daemon y restarted 2024-02-17T23:25:34.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: cluster 2024-02-17T23:25:34.498876+0000 mon.a (mon.0) 726 : cluster [DBG] Standby manager daemon y started 2024-02-17T23:25:34.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.500513+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.501056+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.502137+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.502430+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.683804+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.684177+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.684448+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.684722+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.684987+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.685238+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.686697+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.686968+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.687257+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:34.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.687519+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:34.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:34 smithi080 bash[35203]: audit 2024-02-17T23:25:34.687778+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.079 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:25:35.079 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:25:35.079 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-17T23:25:35.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:25:35.079 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:25:35.079 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:25:35.079 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:25:35.079 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:25:35.079 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-17T23:25:35.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:25:35.080 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:25:35.080 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:25:35.080 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:25:35.080 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:25:35.080 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:25:35.080 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-02-17T23:25:35.080 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:25:35.080 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:25:35.080 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:25:35.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:33.943652+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 97737768, \"cpu_percentage\": \"1.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941381Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 45518684, \"cpu_percentage\": \"107.51%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:33.941550Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 94717870, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941631Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48108666, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941703Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44333793, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941795Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45592084, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941865Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45329940, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941934Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12635340, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942002Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.35%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942069Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 37633392, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942136Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:33.942263Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:35.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:33.943652+0000 mon.b (mon.2) 161 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 97737768, \"cpu_percentage\": \"1.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941381Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 45518684, \"cpu_percentage\": \"107.51%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:33.941550Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 94717870, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941631Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48108666, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941703Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44333793, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941795Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45592084, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941865Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45329940, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941934Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12635340, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942002Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.35%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942069Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 37633392, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942136Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:33.942263Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:35.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:33.944428+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 97737768, \"cpu_percentage\": \"1.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941381Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 45518684, \"cpu_percentage\": \"107.51%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:33.941550Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 94717870, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941631Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48108666, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941703Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44333793, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941795Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45592084, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941865Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45329940, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941934Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12635340, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942002Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.35%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942069Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 37633392, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942136Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:33.942263Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:35.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:33.944428+0000 mon.a (mon.0) 723 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 97737768, \"cpu_percentage\": \"1.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941381Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 45518684, \"cpu_percentage\": \"107.51%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:33.941550Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 94717870, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941631Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48108666, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941703Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44333793, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941795Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45592084, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941865Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45329940, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941934Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12635340, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942002Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.35%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942069Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 37633392, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942136Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:33.942263Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:35.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:33.947405+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 97737768, \"cpu_percentage\": \"1.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941381Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 45518684, \"cpu_percentage\": \"107.51%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:33.941550Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 94717870, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941631Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48108666, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941703Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44333793, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941795Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45592084, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941865Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45329940, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941934Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12635340, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942002Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.35%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942069Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 37633392, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942136Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:33.942263Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:35.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.032112+0000 mgr.x (mgr.34652) 66 : audit [DBG] from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:35.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.365501+0000 mgr.x (mgr.34652) 67 : audit [DBG] from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:35.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: cluster 2024-02-17T23:25:34.498778+0000 mon.a (mon.0) 725 : cluster [DBG] Standby manager daemon y restarted 2024-02-17T23:25:35.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: cluster 2024-02-17T23:25:34.498876+0000 mon.a (mon.0) 726 : cluster [DBG] Standby manager daemon y started 2024-02-17T23:25:35.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.500513+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.501056+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.502137+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.502430+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.683804+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.684177+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.684448+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.684722+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.684987+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:33.947405+0000 mon.a (mon.0) 724 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 97737768, \"cpu_percentage\": \"1.90%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941381Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 45518684, \"cpu_percentage\": \"107.51%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:33.941550Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 94717870, \"cpu_percentage\": \"0.77%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941631Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48108666, \"cpu_percentage\": \"0.49%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941703Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44333793, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941795Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45592084, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941865Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45329940, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.941934Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 12635340, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942002Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.35%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942069Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 37633392, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:33.942136Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:33.942263Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.032112+0000 mgr.x (mgr.34652) 66 : audit [DBG] from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:35.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.365501+0000 mgr.x (mgr.34652) 67 : audit [DBG] from='client.14862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: cluster 2024-02-17T23:25:34.498778+0000 mon.a (mon.0) 725 : cluster [DBG] Standby manager daemon y restarted 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: cluster 2024-02-17T23:25:34.498876+0000 mon.a (mon.0) 726 : cluster [DBG] Standby manager daemon y started 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.500513+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.501056+0000 mon.c (mon.1) 27 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.502137+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.502430+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.683804+0000 mon.b (mon.2) 162 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.684177+0000 mon.b (mon.2) 163 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.684448+0000 mon.b (mon.2) 164 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.684722+0000 mon.b (mon.2) 165 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.684987+0000 mon.b (mon.2) 166 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.685238+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.686697+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.686968+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.687257+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.687519+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[38535]: audit 2024-02-17T23:25:34.687778+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.685238+0000 mon.b (mon.2) 167 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.686697+0000 mon.b (mon.2) 168 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.686968+0000 mon.b (mon.2) 169 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.687257+0000 mon.b (mon.2) 170 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.687519+0000 mon.b (mon.2) 171 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:34 smithi005 bash[35193]: audit 2024-02-17T23:25:34.687778+0000 mon.b (mon.2) 172 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:35.401 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:25:35.401 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:25:35.401 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:25:35.401 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:25:35.401 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:25:35.401 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr" 2024-02-17T23:25:35.401 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:25:35.401 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "2/20 daemons upgraded", 2024-02-17T23:25:35.401 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mgr daemons", 2024-02-17T23:25:35.402 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:25:35.402 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:25:36.293 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:34.682001+0000 mgr.x (mgr.34652) 68 : audit [DBG] from='client.24781 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:36.293 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: cluster 2024-02-17T23:25:34.951106+0000 mon.a (mon.0) 727 : cluster [DBG] mgrmap e20: x(active, since 74s), standbys: y 2024-02-17T23:25:36.293 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.077900+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.15.5:0/1112279342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:25:36.293 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.316886+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 92861890, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.314885Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"10.35%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315025Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46462402, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315109Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43138416, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315170Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 42897244, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315231Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315290Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34131148, \"cpu_percentage\": \"1.09%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315350Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14585692, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315408Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30041702, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315465Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39216742, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315522Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:35.315624Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:36.293 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.317496+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 92861890, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.314885Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"10.35%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315025Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46462402, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315109Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43138416, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315170Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 42897244, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315231Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315290Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34131148, \"cpu_percentage\": \"1.09%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315350Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14585692, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315408Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30041702, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315465Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39216742, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315522Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:35.315624Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:36.293 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.321199+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 92861890, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.314885Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"10.35%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315025Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46462402, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315109Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43138416, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315170Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 42897244, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315231Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315290Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34131148, \"cpu_percentage\": \"1.09%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315350Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14585692, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315408Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30041702, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315465Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39216742, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315522Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:35.315624Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:36.293 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.322535+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:36.293 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.322802+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:36.293 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.324917+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.329553+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.330336+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.330673+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: cephadm 2024-02-17T23:25:35.331233+0000 mgr.x (mgr.34652) 69 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: cephadm 2024-02-17T23:25:35.331543+0000 mgr.x (mgr.34652) 70 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: cephadm 2024-02-17T23:25:35.333439+0000 mgr.x (mgr.34652) 71 : cephadm [INF] Failing over to other MGR 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.333628+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.333970+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.337902+0000 mon.b (mon.2) 178 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: cluster 2024-02-17T23:25:35.337950+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.338539+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.339108+0000 mon.b (mon.2) 179 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.339433+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:25:36.294 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: cluster 2024-02-17T23:25:35.348638+0000 mon.a (mon.0) 737 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:25:36.295 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: audit 2024-02-17T23:25:35.399486+0000 mgr.x (mgr.34652) 72 : audit [DBG] from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:36.295 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:35 smithi080 bash[35203]: cluster 2024-02-17T23:25:35.592160+0000 mgr.x (mgr.34652) 73 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:36.363 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:34.682001+0000 mgr.x (mgr.34652) 68 : audit [DBG] from='client.24781 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:36.363 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: cluster 2024-02-17T23:25:34.951106+0000 mon.a (mon.0) 727 : cluster [DBG] mgrmap e20: x(active, since 74s), standbys: y 2024-02-17T23:25:36.363 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.077900+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.15.5:0/1112279342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:25:36.363 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:34.682001+0000 mgr.x (mgr.34652) 68 : audit [DBG] from='client.24781 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:36.364 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: cluster 2024-02-17T23:25:34.951106+0000 mon.a (mon.0) 727 : cluster [DBG] mgrmap e20: x(active, since 74s), standbys: y 2024-02-17T23:25:36.364 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.077900+0000 mon.c (mon.1) 30 : audit [DBG] from='client.? 172.21.15.5:0/1112279342' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:25:36.364 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.316886+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 92861890, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.314885Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"10.35%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315025Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46462402, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315109Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43138416, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315170Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 42897244, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315231Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315290Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34131148, \"cpu_percentage\": \"1.09%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315350Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14585692, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315408Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30041702, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315465Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39216742, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315522Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:35.315624Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:36.364 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.316886+0000 mon.b (mon.2) 173 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 92861890, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.314885Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"10.35%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315025Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46462402, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315109Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43138416, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315170Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 42897244, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315231Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315290Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34131148, \"cpu_percentage\": \"1.09%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315350Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14585692, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315408Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30041702, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315465Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39216742, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315522Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:35.315624Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:36.365 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.317496+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 92861890, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.314885Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"10.35%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315025Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46462402, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315109Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43138416, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315170Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 42897244, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315231Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315290Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34131148, \"cpu_percentage\": \"1.09%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315350Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14585692, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315408Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30041702, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315465Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39216742, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315522Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:35.315624Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:36.365 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.317496+0000 mon.a (mon.0) 728 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 92861890, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.314885Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"10.35%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315025Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46462402, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315109Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43138416, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315170Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 42897244, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315231Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315290Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34131148, \"cpu_percentage\": \"1.09%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315350Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14585692, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315408Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30041702, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315465Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39216742, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315522Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:35.315624Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]: dispatch 2024-02-17T23:25:36.365 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.321199+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 92861890, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.314885Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"10.35%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315025Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46462402, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315109Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43138416, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315170Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 42897244, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315231Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315290Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34131148, \"cpu_percentage\": \"1.09%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315350Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14585692, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315408Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30041702, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315465Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39216742, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315522Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:35.315624Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.322535+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.322802+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.324917+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.329553+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.330336+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.330673+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: cephadm 2024-02-17T23:25:35.331233+0000 mgr.x (mgr.34652) 69 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: cephadm 2024-02-17T23:25:35.331543+0000 mgr.x (mgr.34652) 70 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: cephadm 2024-02-17T23:25:35.333439+0000 mgr.x (mgr.34652) 71 : cephadm [INF] Failing over to other MGR 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.333628+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-17T23:25:36.366 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.333970+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.321199+0000 mon.a (mon.0) 729 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 92861890, \"cpu_percentage\": \"0.98%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.314885Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 441974784, \"cpu_percentage\": \"10.35%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315025Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46462402, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315109Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43138416, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315170Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 42897244, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315231Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315290Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34131148, \"cpu_percentage\": \"1.09%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315350Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14585692, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315408Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30041702, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315465Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39216742, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:35.315522Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:35.315624Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}}"}]': finished 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.322535+0000 mon.b (mon.2) 174 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.322802+0000 mon.a (mon.0) 730 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.324917+0000 mon.a (mon.0) 731 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.329553+0000 mon.b (mon.2) 175 : audit [DBG] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.330336+0000 mon.b (mon.2) 176 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.330673+0000 mon.a (mon.0) 732 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: cephadm 2024-02-17T23:25:35.331233+0000 mgr.x (mgr.34652) 69 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: cephadm 2024-02-17T23:25:35.331543+0000 mgr.x (mgr.34652) 70 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.x) 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: cephadm 2024-02-17T23:25:35.333439+0000 mgr.x (mgr.34652) 71 : cephadm [INF] Failing over to other MGR 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.333628+0000 mon.b (mon.2) 177 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-17T23:25:36.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.333970+0000 mon.a (mon.0) 733 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-02-17T23:25:36.368 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.337902+0000 mon.b (mon.2) 178 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:25:36.368 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: cluster 2024-02-17T23:25:35.337950+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-17T23:25:36.368 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.338539+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:25:36.368 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.339108+0000 mon.b (mon.2) 179 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:25:36.368 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.339433+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:25:36.368 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: cluster 2024-02-17T23:25:35.348638+0000 mon.a (mon.0) 737 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:25:36.368 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: audit 2024-02-17T23:25:35.399486+0000 mgr.x (mgr.34652) 72 : audit [DBG] from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:36.368 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[38535]: cluster 2024-02-17T23:25:35.592160+0000 mgr.x (mgr.34652) 73 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:36.368 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.337902+0000 mon.b (mon.2) 178 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:25:36.368 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: cluster 2024-02-17T23:25:35.337950+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2024-02-17T23:25:36.369 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.338539+0000 mon.a (mon.0) 735 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:25:36.369 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.339108+0000 mon.b (mon.2) 179 : audit [INF] from='mgr.34652 172.21.15.80:0/4332306' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:25:36.369 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.339433+0000 mon.a (mon.0) 736 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:25:36.369 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: cluster 2024-02-17T23:25:35.348638+0000 mon.a (mon.0) 737 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:25:36.369 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: audit 2024-02-17T23:25:35.399486+0000 mgr.x (mgr.34652) 72 : audit [DBG] from='client.14880 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:25:36.369 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:35 smithi005 bash[35193]: cluster 2024-02-17T23:25:35.592160+0000 mgr.x (mgr.34652) 73 : cluster [DBG] pgmap v38: 129 pgs: 129 active+clean; 7.0 KiB data, 5.6 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:36.575 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:36 smithi080 bash[48624]: debug 2024-02-17T23:25:36.331+0000 7f43c70b0700 -1 mgr handle_mgr_map I was active but no longer am 2024-02-17T23:25:36.575 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:36 smithi080 bash[48624]: ignoring --setuser ceph since I am not root 2024-02-17T23:25:36.576 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:36 smithi080 bash[48624]: ignoring --setgroup ceph since I am not root 2024-02-17T23:25:36.576 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:36 smithi080 bash[48624]: debug 2024-02-17T23:25:36.371+0000 7feb7b1d1700 1 -- 172.21.15.80:0/146753040 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564e1ccb64e0 con 0x564e1cc8cc00 2024-02-17T23:25:36.576 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:36 smithi080 bash[48624]: debug 2024-02-17T23:25:36.493+0000 7feb8b3ae680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T23:25:36.576 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:36 smithi080 bash[48624]: debug 2024-02-17T23:25:36.573+0000 7feb8b3ae680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T23:25:37.331 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:36 smithi080 bash[48624]: debug 2024-02-17T23:25:36.936+0000 7feb8b3ae680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T23:25:37.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:37 smithi005 bash[38535]: audit 2024-02-17T23:25:36.331458+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-17T23:25:37.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:37 smithi005 bash[38535]: cluster 2024-02-17T23:25:36.331525+0000 mon.a (mon.0) 739 : cluster [DBG] mgrmap e21: y(active, starting, since 0.997033s), standbys: x 2024-02-17T23:25:37.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:37 smithi005 bash[38535]: audit 2024-02-17T23:25:36.342000+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-17T23:25:37.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:37 smithi005 bash[38535]: cluster 2024-02-17T23:25:36.342053+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-17T23:25:37.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:37 smithi005 bash[35193]: audit 2024-02-17T23:25:36.331458+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-17T23:25:37.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:37 smithi005 bash[35193]: cluster 2024-02-17T23:25:36.331525+0000 mon.a (mon.0) 739 : cluster [DBG] mgrmap e21: y(active, starting, since 0.997033s), standbys: x 2024-02-17T23:25:37.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:37 smithi005 bash[35193]: audit 2024-02-17T23:25:36.342000+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-17T23:25:37.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:37 smithi005 bash[35193]: cluster 2024-02-17T23:25:36.342053+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-17T23:25:37.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:37 smithi080 bash[35203]: audit 2024-02-17T23:25:36.331458+0000 mon.a (mon.0) 738 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-02-17T23:25:37.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:37 smithi080 bash[35203]: cluster 2024-02-17T23:25:36.331525+0000 mon.a (mon.0) 739 : cluster [DBG] mgrmap e21: y(active, starting, since 0.997033s), standbys: x 2024-02-17T23:25:37.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:37 smithi080 bash[35203]: audit 2024-02-17T23:25:36.342000+0000 mon.a (mon.0) 740 : audit [INF] from='mgr.34652 ' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-17T23:25:37.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:37 smithi080 bash[35203]: cluster 2024-02-17T23:25:36.342053+0000 mon.a (mon.0) 741 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-17T23:25:37.966 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:37 smithi080 bash[48624]: debug 2024-02-17T23:25:37.669+0000 7feb8b3ae680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T23:25:37.966 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:37 smithi080 bash[48624]: debug 2024-02-17T23:25:37.753+0000 7feb8b3ae680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T23:25:39.188 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:37 smithi080 bash[48624]: debug 2024-02-17T23:25:37.964+0000 7feb8b3ae680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T23:25:39.188 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:38 smithi080 bash[48624]: debug 2024-02-17T23:25:38.892+0000 7feb8b3ae680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T23:25:39.188 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:39 smithi080 bash[48624]: debug 2024-02-17T23:25:39.018+0000 7feb8b3ae680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:25:39.188 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:39 smithi080 bash[48624]: debug 2024-02-17T23:25:39.096+0000 7feb8b3ae680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T23:25:39.188 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:39 smithi080 bash[48624]: debug 2024-02-17T23:25:39.186+0000 7feb8b3ae680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T23:25:39.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:39 smithi080 bash[48624]: debug 2024-02-17T23:25:39.381+0000 7feb8b3ae680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T23:25:40.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:39 smithi080 bash[48624]: debug 2024-02-17T23:25:39.663+0000 7feb8b3ae680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T23:25:40.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:39 smithi080 bash[48624]: debug 2024-02-17T23:25:39.761+0000 7feb8b3ae680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T23:25:40.823 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:40 smithi080 bash[48624]: debug 2024-02-17T23:25:40.474+0000 7feb8b3ae680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T23:25:40.823 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:40 smithi080 bash[48624]: debug 2024-02-17T23:25:40.556+0000 7feb8b3ae680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T23:25:40.823 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:40 smithi080 bash[48624]: debug 2024-02-17T23:25:40.648+0000 7feb8b3ae680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T23:25:41.342 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:40 smithi080 bash[48624]: debug 2024-02-17T23:25:40.821+0000 7feb8b3ae680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T23:25:41.343 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[48624]: debug 2024-02-17T23:25:41.077+0000 7feb8b3ae680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T23:25:41.343 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[48624]: debug 2024-02-17T23:25:41.209+0000 7feb8b3ae680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T23:25:41.597 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[48624]: debug 2024-02-17T23:25:41.340+0000 7feb8b3ae680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:25:41.598 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[48624]: debug 2024-02-17T23:25:41.512+0000 7feb8b3ae680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T23:25:41.889 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[48624]: debug 2024-02-17T23:25:41.595+0000 7feb8b3ae680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T23:25:41.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[35203]: cluster 2024-02-17T23:25:41.610443+0000 mon.a (mon.0) 742 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:25:41.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[35203]: cluster 2024-02-17T23:25:41.610585+0000 mon.a (mon.0) 743 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:25:41.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[35203]: audit 2024-02-17T23:25:41.610662+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:25:41.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[35203]: audit 2024-02-17T23:25:41.610971+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:25:41.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[35203]: audit 2024-02-17T23:25:41.611839+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:25:41.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:41 smithi080 bash[35203]: audit 2024-02-17T23:25:41.612046+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:25:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[35193]: cluster 2024-02-17T23:25:41.610443+0000 mon.a (mon.0) 742 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:25:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[35193]: cluster 2024-02-17T23:25:41.610585+0000 mon.a (mon.0) 743 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:25:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[35193]: audit 2024-02-17T23:25:41.610662+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:25:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[35193]: audit 2024-02-17T23:25:41.610971+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:25:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[35193]: audit 2024-02-17T23:25:41.611839+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:25:42.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[35193]: audit 2024-02-17T23:25:41.612046+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:25:42.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[38535]: cluster 2024-02-17T23:25:41.610443+0000 mon.a (mon.0) 742 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:25:42.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[38535]: cluster 2024-02-17T23:25:41.610585+0000 mon.a (mon.0) 743 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:25:42.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[38535]: audit 2024-02-17T23:25:41.610662+0000 mon.b (mon.2) 180 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:25:42.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[38535]: audit 2024-02-17T23:25:41.610971+0000 mon.b (mon.2) 181 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:25:42.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[38535]: audit 2024-02-17T23:25:41.611839+0000 mon.b (mon.2) 182 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:25:42.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:41 smithi005 bash[38535]: audit 2024-02-17T23:25:41.612046+0000 mon.b (mon.2) 183 : audit [DBG] from='mgr.? 172.21.15.80:0/631948579' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:25:42.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: [79B blob data] 2024-02-17T23:25:42.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:25:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: [78B blob data] 2024-02-17T23:25:42.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: cluster 2024-02-17T23:25:41.668059+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e22: y(active, starting, since 6s), standbys: x 2024-02-17T23:25:42.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:41.670579+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:25:42.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:41.670737+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:25:42.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.334940+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.335167+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.335403+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.337032+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.337366+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.337624+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.337856+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.338155+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.338451+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.338796+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.339124+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.339454+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.339683+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.340218+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.341016+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:25:42.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.341978+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: cluster 2024-02-17T23:25:41.668059+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e22: y(active, starting, since 6s), standbys: x 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:41.670579+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:41.670737+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.334940+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.335167+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.335403+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.337032+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.337366+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.337624+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.337856+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.338155+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:25:42.878 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.338451+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:25:42.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.338796+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:25:42.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.339124+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:25:42.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.339454+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:25:42.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.339683+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:25:42.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.340218+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:25:42.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.341016+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:25:42.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.341978+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-17T23:25:42.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.342396+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.342803+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.343204+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi005"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.343606+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.343994+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.344363+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.344732+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.345112+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.345491+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.345861+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.346243+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.346630+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.346987+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.347357+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-17T23:25:42.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.347721+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.348061+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.348429+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.348786+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.349157+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.349509+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.349864+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.350224+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: cluster 2024-02-17T23:25:42.376784+0000 mon.a (mon.0) 745 : cluster [INF] Manager daemon y is now available 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.388953+0000 mon.c (mon.1) 71 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.389327+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.392571+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.492931+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.494134+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.536969+0000 mon.c (mon.1) 74 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:25:42.881 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.537381+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:25:42.882 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.544018+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:25:42.882 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[38535]: audit 2024-02-17T23:25:42.544390+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:25:42.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.342396+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-17T23:25:42.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.342803+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-17T23:25:42.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.343204+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi005"}]: dispatch 2024-02-17T23:25:42.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.343606+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-02-17T23:25:42.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.343994+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-17T23:25:42.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.344363+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-17T23:25:42.882 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.344732+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.345112+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.345491+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.345861+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.346243+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.346630+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.346987+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.347357+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.347721+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.348061+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.348429+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.348786+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.349157+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.349509+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.349864+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:25:42.883 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.350224+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:25:42.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: cluster 2024-02-17T23:25:42.376784+0000 mon.a (mon.0) 745 : cluster [INF] Manager daemon y is now available 2024-02-17T23:25:42.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.388953+0000 mon.c (mon.1) 71 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:25:42.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.389327+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:25:42.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.392571+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-17T23:25:42.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.492931+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:42.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.494134+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:42.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.536969+0000 mon.c (mon.1) 74 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:25:42.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.537381+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:25:42.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.544018+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:25:42.884 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:42 smithi005 bash[35193]: audit 2024-02-17T23:25:42.544390+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:25:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: cluster 2024-02-17T23:25:41.668059+0000 mon.a (mon.0) 744 : cluster [DBG] mgrmap e22: y(active, starting, since 6s), standbys: x 2024-02-17T23:25:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:41.670579+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:25:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:41.670737+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.? 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:25:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.334940+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:25:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.335167+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:25:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.335403+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:25:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.337032+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:25:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.337366+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:25:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.337624+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:25:42.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.337856+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.338155+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.338451+0000 mon.c (mon.1) 41 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.338796+0000 mon.c (mon.1) 42 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.339124+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.339454+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.339683+0000 mon.c (mon.1) 45 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.340218+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.341016+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.341978+0000 mon.c (mon.1) 48 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.342396+0000 mon.c (mon.1) 49 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.342803+0000 mon.c (mon.1) 50 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.343204+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi005"}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.343606+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-02-17T23:25:42.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.343994+0000 mon.c (mon.1) 53 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.344363+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.344732+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.345112+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.345491+0000 mon.c (mon.1) 57 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.345861+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.346243+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.346630+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.346987+0000 mon.c (mon.1) 61 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.347357+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.347721+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.348061+0000 mon.c (mon.1) 64 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.348429+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.348786+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:25:42.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.349157+0000 mon.c (mon.1) 67 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.349509+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.349864+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.350224+0000 mon.c (mon.1) 70 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: cluster 2024-02-17T23:25:42.376784+0000 mon.a (mon.0) 745 : cluster [INF] Manager daemon y is now available 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.388953+0000 mon.c (mon.1) 71 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.389327+0000 mon.a (mon.0) 746 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}}"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.392571+0000 mon.a (mon.0) 747 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/inventory","val":"{\"smithi005\": {\"hostname\": \"smithi005\", \"addr\": \"172.21.15.5\", \"labels\": [], \"status\": \"\"}, \"smithi080\": {\"hostname\": \"smithi080\", \"addr\": \"172.21.15.80\", \"labels\": [], \"status\": \"\"}}"}]': finished 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.492931+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.494134+0000 mon.c (mon.1) 73 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.536969+0000 mon.c (mon.1) 74 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.537381+0000 mon.a (mon.0) 748 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.544018+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:25:42.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:42 smithi080 bash[35203]: audit 2024-02-17T23:25:42.544390+0000 mon.a (mon.0) 749 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:25:43.815 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:43 smithi005 bash[35193]: cephadm 2024-02-17T23:25:42.388532+0000 mgr.y (mgr.24763) 1 : cephadm [INF] inventory: adjusted host smithi080 addr 'smithi080' -> '172.21.15.80' 2024-02-17T23:25:43.816 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:43 smithi005 bash[35193]: cluster 2024-02-17T23:25:42.687013+0000 mon.a (mon.0) 750 : cluster [DBG] mgrmap e23: y(active, since 7s), standbys: x 2024-02-17T23:25:43.816 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:43 smithi005 bash[35193]: audit 2024-02-17T23:25:42.717004+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:43.816 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:43 smithi005 bash[35193]: audit 2024-02-17T23:25:42.719203+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:43.816 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:43 smithi005 bash[38535]: cephadm 2024-02-17T23:25:42.388532+0000 mgr.y (mgr.24763) 1 : cephadm [INF] inventory: adjusted host smithi080 addr 'smithi080' -> '172.21.15.80' 2024-02-17T23:25:43.816 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:43 smithi005 bash[38535]: cluster 2024-02-17T23:25:42.687013+0000 mon.a (mon.0) 750 : cluster [DBG] mgrmap e23: y(active, since 7s), standbys: x 2024-02-17T23:25:43.817 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:43 smithi005 bash[38535]: audit 2024-02-17T23:25:42.717004+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:43.817 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:43 smithi005 bash[38535]: audit 2024-02-17T23:25:42.719203+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:44.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:43 smithi080 bash[35203]: cephadm 2024-02-17T23:25:42.388532+0000 mgr.y (mgr.24763) 1 : cephadm [INF] inventory: adjusted host smithi080 addr 'smithi080' -> '172.21.15.80' 2024-02-17T23:25:44.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:43 smithi080 bash[35203]: cluster 2024-02-17T23:25:42.687013+0000 mon.a (mon.0) 750 : cluster [DBG] mgrmap e23: y(active, since 7s), standbys: x 2024-02-17T23:25:44.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:43 smithi080 bash[35203]: audit 2024-02-17T23:25:42.717004+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:44.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:43 smithi080 bash[35203]: audit 2024-02-17T23:25:42.719203+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:25:44.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:44 smithi080 bash[35203]: cluster 2024-02-17T23:25:42.703641+0000 mgr.y (mgr.24763) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:45.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:44 smithi005 bash[35193]: cluster 2024-02-17T23:25:42.703641+0000 mgr.y (mgr.24763) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:45.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:44 smithi005 bash[38535]: cluster 2024-02-17T23:25:42.703641+0000 mgr.y (mgr.24763) 2 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:46.006 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:45 smithi080 bash[35203]: cluster 2024-02-17T23:25:44.338725+0000 mgr.y (mgr.24763) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:46.007 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:45 smithi080 bash[35203]: cluster 2024-02-17T23:25:44.766686+0000 mon.a (mon.0) 751 : cluster [DBG] mgrmap e24: y(active, since 9s), standbys: x 2024-02-17T23:25:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:45 smithi005 bash[38535]: cluster 2024-02-17T23:25:44.338725+0000 mgr.y (mgr.24763) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:45 smithi005 bash[38535]: cluster 2024-02-17T23:25:44.766686+0000 mon.a (mon.0) 751 : cluster [DBG] mgrmap e24: y(active, since 9s), standbys: x 2024-02-17T23:25:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:45 smithi005 bash[35193]: cluster 2024-02-17T23:25:44.338725+0000 mgr.y (mgr.24763) 3 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:45 smithi005 bash[35193]: cluster 2024-02-17T23:25:44.766686+0000 mon.a (mon.0) 751 : cluster [DBG] mgrmap e24: y(active, since 9s), standbys: x 2024-02-17T23:25:47.126 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:25:46 smithi005 bash[57630]: ts=2024-02-17T23:25:46.953Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-17T23:25:47.888 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:47 smithi080 bash[35203]: cluster 2024-02-17T23:25:46.339145+0000 mgr.y (mgr.24763) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:47 smithi005 bash[35193]: cluster 2024-02-17T23:25:46.339145+0000 mgr.y (mgr.24763) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:47 smithi005 bash[38535]: cluster 2024-02-17T23:25:46.339145+0000 mgr.y (mgr.24763) 4 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:48.978 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:47.961057+0000 mon.c (mon.1) 78 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 105067315, \"cpu_percentage\": \"1.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959043Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:47.959854Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:48.979 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:47.961575+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 105067315, \"cpu_percentage\": \"1.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959043Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:47.959854Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:48.979 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:47.965602+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 105067315, \"cpu_percentage\": \"1.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959043Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:47.959854Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:25:48.979 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.234313+0000 mon.c (mon.1) 79 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 399822028, \"cpu_percentage\": \"15.53%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232481Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:48.233128Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.234851+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 399822028, \"cpu_percentage\": \"15.53%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232481Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:48.233128Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.238162+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 399822028, \"cpu_percentage\": \"15.53%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232481Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:48.233128Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.258641+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.259047+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.259378+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.259698+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.260025+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.260341+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.260656+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.260952+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.261269+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:48.980 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.502766+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.503154+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.503532+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.503914+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.504277+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.504588+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.504898+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.505203+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.505524+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.506858+0000 mon.c (mon.1) 98 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.507151+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.510229+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.515585+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.516579+0000 mon.c (mon.1) 100 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:48.981 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:48 smithi080 bash[35203]: audit 2024-02-17T23:25:48.516826+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:49.028 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:47.961057+0000 mon.c (mon.1) 78 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 105067315, \"cpu_percentage\": \"1.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959043Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:47.959854Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:49.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:47.961575+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 105067315, \"cpu_percentage\": \"1.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959043Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:47.959854Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:49.029 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:47.961057+0000 mon.c (mon.1) 78 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 105067315, \"cpu_percentage\": \"1.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959043Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:47.959854Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:49.029 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:47.965602+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 105067315, \"cpu_percentage\": \"1.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959043Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:47.959854Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:25:49.030 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:47.961575+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 105067315, \"cpu_percentage\": \"1.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959043Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:47.959854Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:49.030 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.234313+0000 mon.c (mon.1) 79 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 399822028, \"cpu_percentage\": \"15.53%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232481Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:48.233128Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:49.031 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:47.965602+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"88528bd095e9\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 105067315, \"cpu_percentage\": \"1.91%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959043Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:13:48.028988Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:45.436785Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:47.959854Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:25:49.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.234851+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 399822028, \"cpu_percentage\": \"15.53%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232481Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:48.233128Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:49.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.238162+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 399822028, \"cpu_percentage\": \"15.53%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232481Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:48.233128Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:25:49.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.258641+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.259047+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.031 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.259378+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.259698+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.260025+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.260341+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.260656+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.032 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.234313+0000 mon.c (mon.1) 79 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 399822028, \"cpu_percentage\": \"15.53%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232481Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:48.233128Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:49.032 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.260952+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.261269+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.502766+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.503154+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.503532+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.503914+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.504277+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.504588+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.504898+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.505203+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.505524+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.506858+0000 mon.c (mon.1) 98 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.507151+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.510229+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:25:49.033 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.515585+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:49.034 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.516579+0000 mon.c (mon.1) 100 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:49.034 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[35193]: audit 2024-02-17T23:25:48.516826+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:49.034 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.234851+0000 mon.a (mon.0) 754 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 399822028, \"cpu_percentage\": \"15.53%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232481Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:48.233128Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:25:49.034 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.238162+0000 mon.a (mon.0) 755 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"8c3856f00a71\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph:81bd20d634209c7cb82c18be12b4b5a05643ebf1\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 399822028, \"cpu_percentage\": \"15.53%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232481Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:24:12.968874Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:00.280371Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:25:48.233128Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:25:49.034 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.258641+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.034 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.259047+0000 mon.c (mon.1) 81 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.034 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.259378+0000 mon.c (mon.1) 82 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.259698+0000 mon.c (mon.1) 83 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.260025+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.260341+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.260656+0000 mon.c (mon.1) 86 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.260952+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.261269+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.502766+0000 mon.c (mon.1) 89 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.503154+0000 mon.c (mon.1) 90 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.503532+0000 mon.c (mon.1) 91 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.503914+0000 mon.c (mon.1) 92 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.504277+0000 mon.c (mon.1) 93 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.504588+0000 mon.c (mon.1) 94 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.504898+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.505203+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:25:49.035 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.505524+0000 mon.c (mon.1) 97 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:25:49.036 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.506858+0000 mon.c (mon.1) 98 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:49.036 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.507151+0000 mon.a (mon.0) 756 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:25:49.036 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.510229+0000 mon.a (mon.0) 757 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:25:49.036 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.515585+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:25:49.036 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.516579+0000 mon.c (mon.1) 100 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:49.036 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:48 smithi005 bash[38535]: audit 2024-02-17T23:25:48.516826+0000 mon.a (mon.0) 758 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:25:50.046 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:49 smithi080 bash[35203]: cluster 2024-02-17T23:25:48.339768+0000 mgr.y (mgr.24763) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:49 smithi005 bash[35193]: cluster 2024-02-17T23:25:48.339768+0000 mgr.y (mgr.24763) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:50.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:49 smithi005 bash[38535]: cluster 2024-02-17T23:25:48.339768+0000 mgr.y (mgr.24763) 5 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:50.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:50 smithi080 bash[35203]: audit 2024-02-17T23:25:50.063644+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:50.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:50 smithi080 bash[35203]: audit 2024-02-17T23:25:50.064098+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:50.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:50 smithi080 bash[35203]: audit 2024-02-17T23:25:50.065166+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:25:50.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:50 smithi080 bash[35203]: audit 2024-02-17T23:25:50.066112+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:25:50.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:50 smithi080 bash[35203]: audit 2024-02-17T23:25:50.067372+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-17T23:25:51.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:50 smithi005 bash[35193]: audit 2024-02-17T23:25:50.063644+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:51.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:50 smithi005 bash[35193]: audit 2024-02-17T23:25:50.064098+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:51.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:50 smithi005 bash[35193]: audit 2024-02-17T23:25:50.065166+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:25:51.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:50 smithi005 bash[35193]: audit 2024-02-17T23:25:50.066112+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:25:51.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:50 smithi005 bash[35193]: audit 2024-02-17T23:25:50.067372+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-17T23:25:51.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:50 smithi005 bash[38535]: audit 2024-02-17T23:25:50.063644+0000 mon.c (mon.1) 101 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:51.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:50 smithi005 bash[38535]: audit 2024-02-17T23:25:50.064098+0000 mon.a (mon.0) 759 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:25:51.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:50 smithi005 bash[38535]: audit 2024-02-17T23:25:50.065166+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:25:51.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:50 smithi005 bash[38535]: audit 2024-02-17T23:25:50.066112+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:25:51.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:50 smithi005 bash[38535]: audit 2024-02-17T23:25:50.067372+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-17T23:25:51.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:51 smithi080 bash[35203]: cephadm 2024-02-17T23:25:50.063162+0000 mgr.y (mgr.24763) 6 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-17T23:25:51.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:51 smithi080 bash[35203]: cephadm 2024-02-17T23:25:50.066885+0000 mgr.y (mgr.24763) 7 : cephadm [INF] Deploying daemon mgr.x on smithi080 2024-02-17T23:25:51.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:51 smithi080 bash[35203]: cluster 2024-02-17T23:25:50.340185+0000 mgr.y (mgr.24763) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:51.891 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:25:51 smithi080 systemd[1]: Stopping Ceph mgr.x for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:25:52.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:51 smithi005 bash[35193]: cephadm 2024-02-17T23:25:50.063162+0000 mgr.y (mgr.24763) 6 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-17T23:25:52.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:51 smithi005 bash[35193]: cephadm 2024-02-17T23:25:50.066885+0000 mgr.y (mgr.24763) 7 : cephadm [INF] Deploying daemon mgr.x on smithi080 2024-02-17T23:25:52.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:51 smithi005 bash[35193]: cluster 2024-02-17T23:25:50.340185+0000 mgr.y (mgr.24763) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:52.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:51 smithi005 bash[38535]: cephadm 2024-02-17T23:25:50.063162+0000 mgr.y (mgr.24763) 6 : cephadm [INF] Upgrade: Updating mgr.x 2024-02-17T23:25:52.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:51 smithi005 bash[38535]: cephadm 2024-02-17T23:25:50.066885+0000 mgr.y (mgr.24763) 7 : cephadm [INF] Deploying daemon mgr.x on smithi080 2024-02-17T23:25:52.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:51 smithi005 bash[38535]: cluster 2024-02-17T23:25:50.340185+0000 mgr.y (mgr.24763) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:53.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:52 smithi005 bash[35193]: cluster 2024-02-17T23:25:52.340593+0000 mgr.y (mgr.24763) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:53.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:52 smithi005 bash[38535]: cluster 2024-02-17T23:25:52.340593+0000 mgr.y (mgr.24763) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:53.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:52 smithi080 bash[35203]: cluster 2024-02-17T23:25:52.340593+0000 mgr.y (mgr.24763) 9 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:55.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:54 smithi005 bash[35193]: cluster 2024-02-17T23:25:54.341439+0000 mgr.y (mgr.24763) 10 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:55.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:54 smithi005 bash[38535]: cluster 2024-02-17T23:25:54.341439+0000 mgr.y (mgr.24763) 10 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:55.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:54 smithi080 bash[35203]: cluster 2024-02-17T23:25:54.341439+0000 mgr.y (mgr.24763) 10 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:57.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:57 smithi005 bash[35193]: cluster 2024-02-17T23:25:56.341848+0000 mgr.y (mgr.24763) 11 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:57.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:57 smithi005 bash[38535]: cluster 2024-02-17T23:25:56.341848+0000 mgr.y (mgr.24763) 11 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:57.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:57 smithi080 bash[35203]: cluster 2024-02-17T23:25:56.341848+0000 mgr.y (mgr.24763) 11 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:59.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:25:59 smithi005 bash[35193]: cluster 2024-02-17T23:25:58.342718+0000 mgr.y (mgr.24763) 12 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:59.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:25:59 smithi005 bash[38535]: cluster 2024-02-17T23:25:58.342718+0000 mgr.y (mgr.24763) 12 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:25:59.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:25:59 smithi080 bash[35203]: cluster 2024-02-17T23:25:58.342718+0000 mgr.y (mgr.24763) 12 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:01.763 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:01 smithi080 bash[35203]: cluster 2024-02-17T23:26:00.343271+0000 mgr.y (mgr.24763) 13 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:01.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:01 smithi005 bash[35193]: cluster 2024-02-17T23:26:00.343271+0000 mgr.y (mgr.24763) 13 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:01.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:01 smithi005 bash[38535]: cluster 2024-02-17T23:26:00.343271+0000 mgr.y (mgr.24763) 13 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:02.135 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:01 smithi080 bash[52439]: time="2024-02-17T23:26:01Z" level=warning msg="StopSignal SIGTERM failed to stop container ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.x in 10 seconds, resorting to SIGKILL" 2024-02-17T23:26:02.390 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:02 smithi080 bash[52439]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.x 2024-02-17T23:26:02.889 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:02 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.x.service: Main process exited, code=exited, status=137/n/a 2024-02-17T23:26:03.390 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:02 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.x.service: Failed with result 'exit-code'. 2024-02-17T23:26:03.391 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:02 smithi080 systemd[1]: Stopped Ceph mgr.x for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:26:03.391 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:03 smithi080 systemd[1]: Starting Ceph mgr.x for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:26:03.672 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:03 smithi080 bash[35203]: cluster 2024-02-17T23:26:02.343805+0000 mgr.y (mgr.24763) 14 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:03.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:03 smithi005 bash[35193]: cluster 2024-02-17T23:26:02.343805+0000 mgr.y (mgr.24763) 14 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:03.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:03 smithi005 bash[38535]: cluster 2024-02-17T23:26:02.343805+0000 mgr.y (mgr.24763) 14 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:04.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:03.669+0000 7fc157674700 1 -- 172.21.15.80:0/1007362082 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5568bbfa04e0 con 0x5568bbf75400 2024-02-17T23:26:04.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:03 smithi080 bash[52633]: 4db9cf00b8fa9955c4677f66f7da95d45220bc28047bd1fd3abe6f655505c893 2024-02-17T23:26:04.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:03 smithi080 systemd[1]: Started Ceph mgr.x for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:26:04.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:03.796+0000 7fc167c6f680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T23:26:04.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:03.881+0000 7fc167c6f680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T23:26:04.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:04.291+0000 7fc167c6f680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T23:26:05.083 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:04 smithi080 bash[35203]: audit 2024-02-17T23:26:03.808031+0000 mon.c (mon.1) 105 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:05.083 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:04 smithi080 bash[35203]: audit 2024-02-17T23:26:03.808634+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:05.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:04 smithi080 bash[35203]: audit 2024-02-17T23:26:03.812279+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:26:05.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:04 smithi080 bash[35203]: audit 2024-02-17T23:26:03.813526+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:05.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:04 smithi080 bash[35203]: audit 2024-02-17T23:26:03.815238+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:05.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:04 smithi080 bash[35203]: cluster 2024-02-17T23:26:04.344621+0000 mgr.y (mgr.24763) 15 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:05.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[35193]: audit 2024-02-17T23:26:03.808031+0000 mon.c (mon.1) 105 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:05.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[38535]: audit 2024-02-17T23:26:03.808031+0000 mon.c (mon.1) 105 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:05.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[35193]: audit 2024-02-17T23:26:03.808634+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:05.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[35193]: audit 2024-02-17T23:26:03.812279+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:26:05.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[35193]: audit 2024-02-17T23:26:03.813526+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:05.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[35193]: audit 2024-02-17T23:26:03.815238+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:05.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[35193]: cluster 2024-02-17T23:26:04.344621+0000 mgr.y (mgr.24763) 15 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:05.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[38535]: audit 2024-02-17T23:26:03.808634+0000 mon.a (mon.0) 760 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:05.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[38535]: audit 2024-02-17T23:26:03.812279+0000 mon.a (mon.0) 761 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 99363061, \"cpu_percentage\": \"1.00%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232341Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": [8443]}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46808432, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232555Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232621Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43232788, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232686Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46640660, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232750Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\", \"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\"], \"memory_usage\": 34403778, \"cpu_percentage\": \"0.91%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232816Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 14302576, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.232880Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 30146560, \"cpu_percentage\": \"0.45%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:48.232942Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39992688, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:48.233005Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:26:05.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[38535]: audit 2024-02-17T23:26:03.813526+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:05.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[38535]: audit 2024-02-17T23:26:03.815238+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:05.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:04 smithi005 bash[38535]: cluster 2024-02-17T23:26:04.344621+0000 mgr.y (mgr.24763) 15 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:05.370 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:05.066+0000 7fc167c6f680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T23:26:05.371 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:05.152+0000 7fc167c6f680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T23:26:05.639 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:05.368+0000 7fc167c6f680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T23:26:05.746 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:26:06.378 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:26:06.378 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (68s) 18s ago 6m 16.0M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:26:06.378 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (6m) 18s ago 6m 28.7M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:26:06.378 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 starting - - - - 2024-02-17T23:26:06.378 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (38s) 18s ago 12m 408M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:26:06.378 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (12m) 18s ago 12m 100M 2048M 15.2.0 204a01f9b0b6 88528bd095e9 2024-02-17T23:26:06.378 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (10m) 18s ago 10m 94.7M 2048M 15.2.0 204a01f9b0b6 627dfcd31839 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (11m) 18s ago 11m 96.5M 2048M 15.2.0 204a01f9b0b6 a3ec149a5abb 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (6m) 18s ago 7m 12.2M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (7m) 18s ago 7m 13.6M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (10m) 18s ago 10m 46.1M 4096M 15.2.0 204a01f9b0b6 e7811399e7c1 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (9m) 18s ago 9m 42.5M 4096M 15.2.0 204a01f9b0b6 61f8f838512a 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (9m) 18s ago 9m 43.9M 4096M 15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (9m) 18s ago 9m 43.5M 4096M 15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (8m) 18s ago 8m 44.6M 4096M 15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (8m) 18s ago 8m 41.4M 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (8m) 18s ago 8m 41.2M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (7m) 18s ago 7m 44.4M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (55s) 18s ago 7m 32.8M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (5m) 18s ago 5m 36.7M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:26:06.379 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (5m) 18s ago 5m 38.1M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:26:06.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:06.380+0000 7fc167c6f680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T23:26:06.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:06.530+0000 7fc167c6f680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:26:06.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:06.615+0000 7fc167c6f680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T23:26:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.367579+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:26:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.367925+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:26:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.368242+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.368570+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.368864+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.369163+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.370672+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:26:06.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.370969+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.371284+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.371575+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:06 smithi080 bash[35203]: audit 2024-02-17T23:26:06.371861+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.767 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:26:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:26:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3 2024-02-17T23:26:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:26:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:26:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:26:06.767 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 13, 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:26:06.768 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:26:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.367579+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:26:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.367925+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:26:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.368242+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.368570+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.368864+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.369163+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.370672+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:26:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.370969+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.371284+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.371575+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[38535]: audit 2024-02-17T23:26:06.371861+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.367579+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.367925+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.368242+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.368570+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.368864+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.369163+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.370672+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.370969+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.371284+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.371575+0000 mon.c (mon.1) 117 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:06.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:06 smithi005 bash[35193]: audit 2024-02-17T23:26:06.371861+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:07.088 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:26:07.089 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:26:07.089 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:26:07.089 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:26:07.089 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [], 2024-02-17T23:26:07.089 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "", 2024-02-17T23:26:07.089 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mgr daemons", 2024-02-17T23:26:07.089 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:26:07.089 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:26:07.139 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:06.717+0000 7fc167c6f680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T23:26:07.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:06.915+0000 7fc167c6f680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T23:26:07.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:07.210+0000 7fc167c6f680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T23:26:07.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:07.309+0000 7fc167c6f680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T23:26:07.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:07 smithi080 bash[35203]: audit 2024-02-17T23:26:05.733494+0000 mgr.y (mgr.24763) 16 : audit [DBG] from='client.24817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:07.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:07 smithi080 bash[35203]: audit 2024-02-17T23:26:06.056968+0000 mgr.y (mgr.24763) 17 : audit [DBG] from='client.24823 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:07.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:07 smithi080 bash[35203]: cluster 2024-02-17T23:26:06.344961+0000 mgr.y (mgr.24763) 18 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:07.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:07 smithi080 bash[35203]: audit 2024-02-17T23:26:06.365751+0000 mgr.y (mgr.24763) 19 : audit [DBG] from='client.24829 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:07.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:07 smithi080 bash[35203]: audit 2024-02-17T23:26:06.765790+0000 mon.a (mon.0) 762 : audit [DBG] from='client.? 172.21.15.5:0/2537179094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:07 smithi005 bash[35193]: audit 2024-02-17T23:26:05.733494+0000 mgr.y (mgr.24763) 16 : audit [DBG] from='client.24817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:07 smithi005 bash[35193]: audit 2024-02-17T23:26:06.056968+0000 mgr.y (mgr.24763) 17 : audit [DBG] from='client.24823 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:07 smithi005 bash[35193]: cluster 2024-02-17T23:26:06.344961+0000 mgr.y (mgr.24763) 18 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:07 smithi005 bash[35193]: audit 2024-02-17T23:26:06.365751+0000 mgr.y (mgr.24763) 19 : audit [DBG] from='client.24829 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:07.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:07 smithi005 bash[35193]: audit 2024-02-17T23:26:06.765790+0000 mon.a (mon.0) 762 : audit [DBG] from='client.? 172.21.15.5:0/2537179094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:07 smithi005 bash[38535]: audit 2024-02-17T23:26:05.733494+0000 mgr.y (mgr.24763) 16 : audit [DBG] from='client.24817 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:07 smithi005 bash[38535]: audit 2024-02-17T23:26:06.056968+0000 mgr.y (mgr.24763) 17 : audit [DBG] from='client.24823 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:07.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:07 smithi005 bash[38535]: cluster 2024-02-17T23:26:06.344961+0000 mgr.y (mgr.24763) 18 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:07.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:07 smithi005 bash[38535]: audit 2024-02-17T23:26:06.365751+0000 mgr.y (mgr.24763) 19 : audit [DBG] from='client.24829 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:07.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:07 smithi005 bash[38535]: audit 2024-02-17T23:26:06.765790+0000 mon.a (mon.0) 762 : audit [DBG] from='client.? 172.21.15.5:0/2537179094' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:08.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:08.098+0000 7fc167c6f680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T23:26:08.464 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:08.182+0000 7fc167c6f680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T23:26:08.464 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:08.277+0000 7fc167c6f680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T23:26:08.464 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:08 smithi080 bash[35203]: audit 2024-02-17T23:26:07.087375+0000 mgr.y (mgr.24763) 20 : audit [DBG] from='client.14931 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:08.756 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:08.461+0000 7fc167c6f680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T23:26:08.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:08 smithi005 bash[35193]: audit 2024-02-17T23:26:07.087375+0000 mgr.y (mgr.24763) 20 : audit [DBG] from='client.14931 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:08.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:08 smithi005 bash[38535]: audit 2024-02-17T23:26:07.087375+0000 mgr.y (mgr.24763) 20 : audit [DBG] from='client.14931 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:09.031 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:08.754+0000 7fc167c6f680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T23:26:09.031 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:08.886+0000 7fc167c6f680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T23:26:09.031 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:09.029+0000 7fc167c6f680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:26:09.293 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:09.205+0000 7fc167c6f680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T23:26:09.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:09.291+0000 7fc167c6f680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T23:26:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:09 smithi080 bash[35203]: cluster 2024-02-17T23:26:08.345641+0000 mgr.y (mgr.24763) 21 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:09 smithi080 bash[35203]: cluster 2024-02-17T23:26:09.305621+0000 mon.a (mon.0) 763 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:26:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:09 smithi080 bash[35203]: cluster 2024-02-17T23:26:09.305768+0000 mon.a (mon.0) 764 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:26:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:09 smithi080 bash[35203]: audit 2024-02-17T23:26:09.306271+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:26:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:09 smithi080 bash[35203]: audit 2024-02-17T23:26:09.306614+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:26:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:09 smithi080 bash[35203]: audit 2024-02-17T23:26:09.307559+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:26:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:09 smithi080 bash[35203]: audit 2024-02-17T23:26:09.307817+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:26:09.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[35193]: cluster 2024-02-17T23:26:08.345641+0000 mgr.y (mgr.24763) 21 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:09.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[35193]: cluster 2024-02-17T23:26:09.305621+0000 mon.a (mon.0) 763 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:26:09.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[35193]: cluster 2024-02-17T23:26:09.305768+0000 mon.a (mon.0) 764 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:26:09.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[35193]: audit 2024-02-17T23:26:09.306271+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:26:09.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[35193]: audit 2024-02-17T23:26:09.306614+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:26:09.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[35193]: audit 2024-02-17T23:26:09.307559+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:26:09.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[35193]: audit 2024-02-17T23:26:09.307817+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:26:09.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[38535]: cluster 2024-02-17T23:26:08.345641+0000 mgr.y (mgr.24763) 21 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:09.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[38535]: cluster 2024-02-17T23:26:09.305621+0000 mon.a (mon.0) 763 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:26:09.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[38535]: cluster 2024-02-17T23:26:09.305768+0000 mon.a (mon.0) 764 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:26:09.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[38535]: audit 2024-02-17T23:26:09.306271+0000 mon.b (mon.2) 184 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:26:09.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[38535]: audit 2024-02-17T23:26:09.306614+0000 mon.b (mon.2) 185 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:26:09.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[38535]: audit 2024-02-17T23:26:09.307559+0000 mon.b (mon.2) 186 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:26:09.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:09 smithi005 bash[38535]: audit 2024-02-17T23:26:09.307817+0000 mon.b (mon.2) 187 : audit [DBG] from='mgr.? 172.21.15.80:0/531356666' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:26:10.804 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.601485+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 103829995, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599167Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 48716840, \"cpu_percentage\": \"108.00%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:09.599354Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46944747, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599448Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43589304, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599531Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43337646, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599611Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46776975, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599690Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34749808, \"cpu_percentage\": \"0.74%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599769Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14313062, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599849Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36123443, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599926Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40244346, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.600004Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:09.600166Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:10.804 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.601485+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 103829995, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599167Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 48716840, \"cpu_percentage\": \"108.00%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:09.599354Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46944747, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599448Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43589304, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599531Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43337646, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599611Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46776975, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599690Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34749808, \"cpu_percentage\": \"0.74%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599769Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14313062, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599849Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36123443, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599926Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40244346, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.600004Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:09.600166Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:10.805 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.602095+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 103829995, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599167Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 48716840, \"cpu_percentage\": \"108.00%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:09.599354Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46944747, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599448Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43589304, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599531Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43337646, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599611Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46776975, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599690Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34749808, \"cpu_percentage\": \"0.74%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599769Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14313062, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599849Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36123443, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599926Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40244346, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.600004Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:09.600166Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:10.805 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.602095+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 103829995, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599167Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 48716840, \"cpu_percentage\": \"108.00%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:09.599354Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46944747, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599448Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43589304, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599531Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43337646, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599611Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46776975, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599690Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34749808, \"cpu_percentage\": \"0.74%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599769Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14313062, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599849Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36123443, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599926Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40244346, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.600004Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:09.600166Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:10.805 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.605948+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 103829995, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599167Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 48716840, \"cpu_percentage\": \"108.00%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:09.599354Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46944747, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599448Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43589304, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599531Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43337646, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599611Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46776975, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599690Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34749808, \"cpu_percentage\": \"0.74%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599769Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14313062, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599849Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36123443, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599926Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40244346, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.600004Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:09.600166Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:26:10.805 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.608392+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:10.805 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.608708+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:10.805 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.612687+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:26:10.806 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.618657+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:10.806 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.619830+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:10.806 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.620153+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:10.806 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.621838+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:10.806 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: cephadm 2024-02-17T23:26:09.622594+0000 mgr.y (mgr.24763) 22 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-17T23:26:10.806 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.622842+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr"}]: dispatch 2024-02-17T23:26:10.806 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.623107+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr"}]: dispatch 2024-02-17T23:26:10.806 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.605948+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 103829995, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599167Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 48716840, \"cpu_percentage\": \"108.00%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:09.599354Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46944747, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599448Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43589304, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599531Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43337646, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599611Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46776975, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599690Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34749808, \"cpu_percentage\": \"0.74%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599769Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14313062, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599849Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36123443, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599926Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40244346, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.600004Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:09.600166Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:26:10.806 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.608392+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:10.806 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.608708+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.612687+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.618657+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.619830+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.620153+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.621838+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: cephadm 2024-02-17T23:26:09.622594+0000 mgr.y (mgr.24763) 22 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.622842+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr"}]: dispatch 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.623107+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr"}]: dispatch 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.627101+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr"}]': finished 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.628374+0000 mon.c (mon.1) 125 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.628673+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-17T23:26:10.807 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.632309+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.633213+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.633495+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.637912+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.639583+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: audit 2024-02-17T23:26:09.640382+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: cephadm 2024-02-17T23:26:09.640927+0000 mgr.y (mgr.24763) 23 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[38535]: cluster 2024-02-17T23:26:09.766954+0000 mon.a (mon.0) 776 : cluster [DBG] mgrmap e25: y(active, since 34s), standbys: x 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.627101+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr"}]': finished 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.628374+0000 mon.c (mon.1) 125 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.628673+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-17T23:26:10.808 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.632309+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-02-17T23:26:10.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.633213+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-17T23:26:10.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.633495+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-17T23:26:10.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.637912+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-02-17T23:26:10.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.639583+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-17T23:26:10.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: audit 2024-02-17T23:26:09.640382+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-02-17T23:26:10.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: cephadm 2024-02-17T23:26:09.640927+0000 mgr.y (mgr.24763) 23 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-02-17T23:26:10.809 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:10 smithi005 bash[35193]: cluster 2024-02-17T23:26:09.766954+0000 mon.a (mon.0) 776 : cluster [DBG] mgrmap e25: y(active, since 34s), standbys: x 2024-02-17T23:26:10.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.601485+0000 mon.c (mon.1) 119 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 103829995, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599167Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 48716840, \"cpu_percentage\": \"108.00%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:09.599354Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46944747, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599448Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43589304, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599531Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43337646, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599611Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46776975, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599690Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34749808, \"cpu_percentage\": \"0.74%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599769Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14313062, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599849Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36123443, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599926Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40244346, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.600004Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:09.600166Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:10.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.602095+0000 mon.a (mon.0) 765 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 103829995, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599167Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 48716840, \"cpu_percentage\": \"108.00%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:09.599354Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46944747, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599448Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43589304, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599531Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43337646, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599611Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46776975, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599690Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34749808, \"cpu_percentage\": \"0.74%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599769Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14313062, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599849Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36123443, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599926Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40244346, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.600004Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:09.600166Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:10.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.605948+0000 mon.a (mon.0) 766 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 103829995, \"cpu_percentage\": \"1.01%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599167Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 48716840, \"cpu_percentage\": \"108.00%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:09.599354Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46944747, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599448Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43589304, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599531Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43337646, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599611Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46776975, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599690Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 34749808, \"cpu_percentage\": \"0.74%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599769Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14313062, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599849Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36123443, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.599926Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40244346, \"cpu_percentage\": \"0.16%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:09.600004Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:09.600166Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]': finished 2024-02-17T23:26:10.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.608392+0000 mon.c (mon.1) 120 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:10.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.608708+0000 mon.a (mon.0) 767 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.612687+0000 mon.a (mon.0) 768 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]': finished 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.618657+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.619830+0000 mon.c (mon.1) 122 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.620153+0000 mon.a (mon.0) 769 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.621838+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: cephadm 2024-02-17T23:26:09.622594+0000 mgr.y (mgr.24763) 22 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.622842+0000 mon.c (mon.1) 124 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr"}]: dispatch 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.623107+0000 mon.a (mon.0) 770 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr"}]: dispatch 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.627101+0000 mon.a (mon.0) 771 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mgr"}]': finished 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.628374+0000 mon.c (mon.1) 125 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.628673+0000 mon.a (mon.0) 772 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.632309+0000 mon.a (mon.0) 773 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.633213+0000 mon.c (mon.1) 126 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-17T23:26:10.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.633495+0000 mon.a (mon.0) 774 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-02-17T23:26:10.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.637912+0000 mon.a (mon.0) 775 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-02-17T23:26:10.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.639583+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-17T23:26:10.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: audit 2024-02-17T23:26:09.640382+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-02-17T23:26:10.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: cephadm 2024-02-17T23:26:09.640927+0000 mgr.y (mgr.24763) 23 : cephadm [INF] Upgrade: It appears safe to stop mon.a 2024-02-17T23:26:10.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:10 smithi080 bash[35203]: cluster 2024-02-17T23:26:09.766954+0000 mon.a (mon.0) 776 : cluster [DBG] mgrmap e25: y(active, since 34s), standbys: x 2024-02-17T23:26:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[35193]: cluster 2024-02-17T23:26:10.346051+0000 mgr.y (mgr.24763) 24 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[35193]: audit 2024-02-17T23:26:11.210009+0000 mon.c (mon.1) 129 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.a"}]: dispatch 2024-02-17T23:26:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[35193]: audit 2024-02-17T23:26:11.210404+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.a"}]: dispatch 2024-02-17T23:26:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[35193]: audit 2024-02-17T23:26:11.214670+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.a"}]': finished 2024-02-17T23:26:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[35193]: audit 2024-02-17T23:26:11.215720+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:26:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[35193]: audit 2024-02-17T23:26:11.216359+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:26:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[35193]: audit 2024-02-17T23:26:11.216976+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:26:11.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[35193]: audit 2024-02-17T23:26:11.217920+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-17T23:26:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[38535]: cluster 2024-02-17T23:26:10.346051+0000 mgr.y (mgr.24763) 24 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[38535]: audit 2024-02-17T23:26:11.210009+0000 mon.c (mon.1) 129 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.a"}]: dispatch 2024-02-17T23:26:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[38535]: audit 2024-02-17T23:26:11.210404+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.a"}]: dispatch 2024-02-17T23:26:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[38535]: audit 2024-02-17T23:26:11.214670+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.a"}]': finished 2024-02-17T23:26:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[38535]: audit 2024-02-17T23:26:11.215720+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:26:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[38535]: audit 2024-02-17T23:26:11.216359+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:26:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[38535]: audit 2024-02-17T23:26:11.216976+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:26:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:11 smithi005 bash[38535]: audit 2024-02-17T23:26:11.217920+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-17T23:26:11.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:11 smithi080 bash[35203]: cluster 2024-02-17T23:26:10.346051+0000 mgr.y (mgr.24763) 24 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:11.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:11 smithi080 bash[35203]: audit 2024-02-17T23:26:11.210009+0000 mon.c (mon.1) 129 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.a"}]: dispatch 2024-02-17T23:26:11.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:11 smithi080 bash[35203]: audit 2024-02-17T23:26:11.210404+0000 mon.a (mon.0) 777 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.a"}]: dispatch 2024-02-17T23:26:11.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:11 smithi080 bash[35203]: audit 2024-02-17T23:26:11.214670+0000 mon.a (mon.0) 778 : audit [INF] from='mgr.24763 ' entity='mgr.y' cmd='[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.a"}]': finished 2024-02-17T23:26:11.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:11 smithi080 bash[35203]: audit 2024-02-17T23:26:11.215720+0000 mon.c (mon.1) 130 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:26:11.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:11 smithi080 bash[35203]: audit 2024-02-17T23:26:11.216359+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:26:11.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:11 smithi080 bash[35203]: audit 2024-02-17T23:26:11.216976+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:26:11.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:11 smithi080 bash[35203]: audit 2024-02-17T23:26:11.217920+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-17T23:26:12.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:12 smithi005 bash[38535]: cephadm 2024-02-17T23:26:11.209576+0000 mgr.y (mgr.24763) 25 : cephadm [INF] Upgrade: Updating mon.a 2024-02-17T23:26:12.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:12 smithi005 bash[38535]: cephadm 2024-02-17T23:26:11.217570+0000 mgr.y (mgr.24763) 26 : cephadm [INF] Deploying daemon mon.a on smithi005 2024-02-17T23:26:12.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:12 smithi005 bash[35193]: cephadm 2024-02-17T23:26:11.209576+0000 mgr.y (mgr.24763) 25 : cephadm [INF] Upgrade: Updating mon.a 2024-02-17T23:26:12.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:12 smithi005 bash[35193]: cephadm 2024-02-17T23:26:11.217570+0000 mgr.y (mgr.24763) 26 : cephadm [INF] Deploying daemon mon.a on smithi005 2024-02-17T23:26:12.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:12 smithi080 bash[35203]: cephadm 2024-02-17T23:26:11.209576+0000 mgr.y (mgr.24763) 25 : cephadm [INF] Upgrade: Updating mon.a 2024-02-17T23:26:12.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:12 smithi080 bash[35203]: cephadm 2024-02-17T23:26:11.217570+0000 mgr.y (mgr.24763) 26 : cephadm [INF] Deploying daemon mon.a on smithi005 2024-02-17T23:26:13.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:13 smithi005 systemd[1]: Stopping Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:26:13.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:13 smithi005 bash[38535]: cluster 2024-02-17T23:26:12.346474+0000 mgr.y (mgr.24763) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:13.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:13 smithi005 bash[35193]: cluster 2024-02-17T23:26:12.346474+0000 mgr.y (mgr.24763) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:13.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:13 smithi005 bash[35193]: debug 2024-02-17T23:26:13.448+0000 7f1601479700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:26:13.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:13 smithi005 bash[35193]: debug 2024-02-17T23:26:13.448+0000 7f1601479700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-02-17T23:26:13.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:13 smithi080 bash[35203]: cluster 2024-02-17T23:26:12.346474+0000 mgr.y (mgr.24763) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:14.367 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:14 smithi005 bash[60330]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon.a 2024-02-17T23:26:15.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:14 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a.service: Succeeded. 2024-02-17T23:26:15.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:14 smithi005 systemd[1]: Stopped Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:26:15.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:14 smithi005 systemd[1]: Starting Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:26:16.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.651+0000 7f1116ae6880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-17T23:26:16.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.651+0000 7f1116ae6880 0 ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable), process ceph-mon, pid 7 2024-02-17T23:26:16.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.651+0000 7f1116ae6880 0 pidfile_write: ignore empty --pid-file 2024-02-17T23:26:16.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 0 load: jerasure load: lrc load: isa 2024-02-17T23:26:16.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: RocksDB version: 6.8.1 2024-02-17T23:26:16.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-17T23:26:16.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Compile date Feb 17 2024 2024-02-17T23:26:16.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: DB SUMMARY 2024-02-17T23:26:16.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: CURRENT file: CURRENT 2024-02-17T23:26:16.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-17T23:26:16.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 741 Bytes 2024-02-17T23:26:16.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 2, files: 000023.sst 000024.sst 2024-02-17T23:26:16.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000021.log size: 21601311 ; 2024-02-17T23:26:16.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.error_if_exists: 0 2024-02-17T23:26:16.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.create_if_missing: 0 2024-02-17T23:26:16.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.paranoid_checks: 1 2024-02-17T23:26:16.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.env: 0x5597c23a5080 2024-02-17T23:26:16.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.fs: Posix File System 2024-02-17T23:26:16.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.info_log: 0x5597c49f8260 2024-02-17T23:26:16.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-17T23:26:16.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.statistics: (nil) 2024-02-17T23:26:16.132 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.use_fsync: 0 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.max_log_file_size: 0 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.allow_fallocate: 1 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.use_direct_reads: 0 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.db_log_dir: 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-17T23:26:16.133 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.max_subcompactions: 1 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.max_background_flushes: -1 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.656+0000 7f1116ae6880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.write_buffer_manager: 0x5597c56ea360 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-17T23:26:16.134 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.unordered_write: 0 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.row_cache: None 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.wal_filter: None 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.preserve_deletes: 0 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.two_write_queues: 0 2024-02-17T23:26:16.135 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.atomic_flush: 0 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.log_readahead_size: 0 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_background_jobs: 2 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_background_compactions: -1 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-17T23:26:16.136 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_open_files: -1 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Compression algorithms supported: 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: kZSTD supported: 0 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: kXpressCompression supported: 0 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-17T23:26:16.137 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: kLZ4Compression supported: 1 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: kBZip2Compression supported: 0 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: kZlibCompression supported: 1 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: kSnappyCompression supported: 1 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.merge_operator: 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_filter: None 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-17T23:26:16.138 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5597c499dd10) 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cache_index_and_filter_blocks: 1 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: pin_top_level_index_and_filter: 1 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: index_type: 0 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: data_block_index_type: 0 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: index_shortening: 1 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: data_block_hash_table_util_ratio: 0.750000 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: hash_index_allow_collision: 1 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: checksum: 1 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: no_block_cache: 0 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: block_cache: 0x5597c49d2f10 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: block_cache_name: BinnedLRUCache 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: block_cache_options: 2024-02-17T23:26:16.139 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: capacity : 536870912 2024-02-17T23:26:16.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: num_shard_bits : 4 2024-02-17T23:26:16.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: strict_capacity_limit : 0 2024-02-17T23:26:16.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: high_pri_pool_ratio: 0.000 2024-02-17T23:26:16.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: block_cache_compressed: (nil) 2024-02-17T23:26:16.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: persistent_cache: (nil) 2024-02-17T23:26:16.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: block_size: 4096 2024-02-17T23:26:16.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: block_size_deviation: 10 2024-02-17T23:26:16.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: block_restart_interval: 16 2024-02-17T23:26:16.140 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: index_block_restart_interval: 1 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: metadata_block_size: 4096 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: partition_filters: 0 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: use_delta_encoding: 1 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: whole_key_filtering: 1 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: verify_compression: 0 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: read_amp_bytes_per_bit: 0 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: format_version: 2 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: enable_index_compression: 1 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: block_align: 0 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-17T23:26:16.141 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compression: NoCompression 2024-02-17T23:26:16.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-17T23:26:16.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-17T23:26:16.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-17T23:26:16.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.num_levels: 7 2024-02-17T23:26:16.142 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:26:16.143 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-17T23:26:16.144 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-17T23:26:16.145 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.table_properties_collectors: 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.inplace_update_support: 0 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.bloom_locality: 0 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.max_successive_merges: 0 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-17T23:26:16.146 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.ttl: 2592000 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.657+0000 7f1116ae6880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.658+0000 7f1116ae6880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 26, last_sequence is 8765, log_number is 21,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.658+0000 7f1116ae6880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 21 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.658+0000 7f1116ae6880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708212375659357, "job": 1, "event": "recovery_started", "log_files": [21]} 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.658+0000 7f1116ae6880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #21 mode 2 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.675+0000 7f1116ae6880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.696+0000 7f1116ae6880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708212375698025, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 26, "file_size": 21345401, "table_properties": {"data_size": 21333211, "index_size": 10150, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1221, "raw_key_size": 10195, "raw_average_key_size": 21, "raw_value_size": 21318768, "raw_average_value_size": 45071, "num_data_blocks": 316, "num_entries": 473, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708212375, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.696+0000 7f1116ae6880 4 rocksdb: [version_set.cc:3826] Creating manifest 27 2024-02-17T23:26:16.147 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.697+0000 7f1116ae6880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708212375698494, "job": 1, "event": "recovery_finished"} 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.699+0000 7f1116ae6880 4 rocksdb: DB pointer 0x5597c4a9b800 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.699+0000 7f10fd8d8700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.699+0000 7f10fd8d8700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ** DB Stats ** 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.148 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ** Compaction Stats [default] ** 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: L0 1/0 20.36 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 950.2 0.02 0.00 1 0.021 0 0 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: L6 2/0 65.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Sum 3/0 85.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 950.2 0.02 0.00 1 0.021 0 0 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 950.2 0.02 0.00 1 0.021 0 0 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ** Compaction Stats [default] ** 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 950.2 0.02 0.00 1 0.021 0 0 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Flush(GB): cumulative 0.020, interval 0.020 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:26:16.149 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Cumulative compaction: 0.02 GB write, 480.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Interval compaction: 0.02 GB write, 480.89 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ** Compaction Stats [default] ** 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:16.150 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: L0 1/0 20.36 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 950.2 0.02 0.00 1 0.021 0 0 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: L6 2/0 65.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Sum 3/0 85.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 950.2 0.02 0.00 1 0.021 0 0 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ** Compaction Stats [default] ** 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 950.2 0.02 0.00 1 0.021 0 0 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Flush(GB): cumulative 0.020, interval 0.000 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:26:16.151 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Cumulative compaction: 0.02 GB write, 480.49 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.700+0000 7f1116ae6880 0 starting mon.a rank 0 at public addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] at bind addrs [v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.701+0000 7f1116ae6880 1 mon.a@-1(???) e3 preinit fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.701+0000 7f1116ae6880 0 mon.a@-1(???).mds e1 new map 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.701+0000 7f1116ae6880 0 mon.a@-1(???).mds e1 print_map 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: e1 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: legacy client fscid: -1 2024-02-17T23:26:16.152 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: No filesystems configured 2024-02-17T23:26:16.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 2024-02-17T23:26:16.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.701+0000 7f1116ae6880 0 mon.a@-1(???).osd e65 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-17T23:26:16.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.701+0000 7f1116ae6880 0 mon.a@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:26:16.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.701+0000 7f1116ae6880 0 mon.a@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:26:16.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.701+0000 7f1116ae6880 0 mon.a@-1(???).osd e65 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:26:16.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:12.346474+0000 mgr.y (mgr.24763) 27 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:16.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:26:15.702+0000 7f1116ae6880 1 mon.a@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-02-17T23:26:16.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 bash[60516]: 879f1e7d963eb95388a68c379720a10d8908434c0c70a0f753ac78d960dc66e2 2024-02-17T23:26:16.153 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:15 smithi005 systemd[1]: Started Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:26:17.495 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: ignoring --setuser ceph since I am not root 2024-02-17T23:26:17.495 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: ignoring --setgroup ceph since I am not root 2024-02-17T23:26:17.495 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:17.190+0000 7fc213dae700 1 -- 172.21.15.80:0/3558179309 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cd0e8364e0 con 0x55cd0e80d000 2024-02-17T23:26:17.495 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:17.317+0000 7fc223f8b680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T23:26:17.495 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:17.397+0000 7fc223f8b680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T23:26:17.495 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: cluster 2024-02-17T23:26:14.347339+0000 mgr.y (mgr.24763) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: audit 2024-02-17T23:26:15.750200+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: cluster 2024-02-17T23:26:16.311039+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: cluster 2024-02-17T23:26:16.347708+0000 mgr.y (mgr.24763) 29 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: cluster 2024-02-17T23:26:17.125038+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: cluster 2024-02-17T23:26:17.129049+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: cluster 2024-02-17T23:26:17.141633+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: cluster 2024-02-17T23:26:17.141697+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: cluster 2024-02-17T23:26:17.142796+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e25: y(active, since 41s), standbys: x 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: cluster 2024-02-17T23:26:17.143256+0000 mon.a (mon.0) 7 : cluster [INF] overall HEALTH_OK 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: cluster 2024-02-17T23:26:17.152096+0000 mon.a (mon.0) 8 : cluster [DBG] mgrmap e26: y(active, since 41s), standbys: x 2024-02-17T23:26:17.496 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:17 smithi080 bash[35203]: audit 2024-02-17T23:26:17.158937+0000 mon.a (mon.0) 9 : audit [INF] from='mgr.24763 ' entity='' 2024-02-17T23:26:17.626 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: ignoring --setuser ceph since I am not root 2024-02-17T23:26:17.626 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: ignoring --setgroup ceph since I am not root 2024-02-17T23:26:17.626 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:17.326+0000 7f371af91680 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-02-17T23:26:17.626 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:17.411+0000 7f371af91680 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-02-17T23:26:17.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: cluster 2024-02-17T23:26:14.347339+0000 mgr.y (mgr.24763) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:17.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:14.347339+0000 mgr.y (mgr.24763) 28 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:17.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: audit 2024-02-17T23:26:15.750200+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:17.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: cluster 2024-02-17T23:26:16.311039+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: cluster 2024-02-17T23:26:16.347708+0000 mgr.y (mgr.24763) 29 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: cluster 2024-02-17T23:26:17.125038+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: cluster 2024-02-17T23:26:17.129049+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: cluster 2024-02-17T23:26:17.141633+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: cluster 2024-02-17T23:26:17.141697+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: cluster 2024-02-17T23:26:17.142796+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e25: y(active, since 41s), standbys: x 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: cluster 2024-02-17T23:26:17.143256+0000 mon.a (mon.0) 7 : cluster [INF] overall HEALTH_OK 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: cluster 2024-02-17T23:26:17.152096+0000 mon.a (mon.0) 8 : cluster [DBG] mgrmap e26: y(active, since 41s), standbys: x 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:17 smithi005 bash[38535]: audit 2024-02-17T23:26:17.158937+0000 mon.a (mon.0) 9 : audit [INF] from='mgr.24763 ' entity='' 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:15.750200+0000 mon.c (mon.1) 134 : audit [INF] from='mgr.24763 172.21.15.5:0/249356426' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 428238438, \"cpu_percentage\": \"48.70%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:25:47.959210Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 101240012, \"cpu_percentage\": \"0.79%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959285Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48402268, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959352Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 44658851, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959416Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46074429, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959478Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45686456, \"cpu_percentage\": \"0.55%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959542Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 12824084, \"cpu_percentage\": \"0.37%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959604Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16840130, \"cpu_percentage\": \"0.34%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:25:47.959667Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 38535168, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:25:47.959729Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:17.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:16.311039+0000 mon.a (mon.0) 1 : cluster [INF] mon.a calling monitor election 2024-02-17T23:26:17.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:16.347708+0000 mgr.y (mgr.24763) 29 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.8 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:17.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:17.125038+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:26:17.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:17.129049+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:26:17.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:17.141633+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2024-02-17T23:26:17.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:17.141697+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2024-02-17T23:26:17.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:17.142796+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e25: y(active, since 41s), standbys: x 2024-02-17T23:26:17.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:17.143256+0000 mon.a (mon.0) 7 : cluster [INF] overall HEALTH_OK 2024-02-17T23:26:17.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:17.152096+0000 mon.a (mon.0) 8 : cluster [DBG] mgrmap e26: y(active, since 41s), standbys: x 2024-02-17T23:26:17.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:17.158937+0000 mon.a (mon.0) 9 : audit [INF] from='mgr.24763 ' entity='' 2024-02-17T23:26:18.125 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:17.793+0000 7f371af91680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T23:26:18.139 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:17.759+0000 7fc223f8b680 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-02-17T23:26:18.799 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:18.500+0000 7fc223f8b680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T23:26:18.799 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:18.585+0000 7fc223f8b680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T23:26:18.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:18.586+0000 7f371af91680 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-02-17T23:26:18.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:18.670+0000 7f371af91680 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-02-17T23:26:19.140 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:18.796+0000 7fc223f8b680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T23:26:19.153 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:18.891+0000 7f371af91680 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-02-17T23:26:19.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:18.153470+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e27: y(active, since 42s), standbys: x 2024-02-17T23:26:19.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:19 smithi005 bash[38535]: cluster 2024-02-17T23:26:18.153470+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e27: y(active, since 42s), standbys: x 2024-02-17T23:26:19.639 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:19 smithi080 bash[35203]: cluster 2024-02-17T23:26:18.153470+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e27: y(active, since 42s), standbys: x 2024-02-17T23:26:20.031 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:19.726+0000 7fc223f8b680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T23:26:20.032 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:19.855+0000 7fc223f8b680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:26:20.032 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:19.934+0000 7fc223f8b680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T23:26:20.190 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:19.876+0000 7f371af91680 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-02-17T23:26:20.191 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:20.011+0000 7f371af91680 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:26:20.191 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:20.093+0000 7f371af91680 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-02-17T23:26:20.191 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:20.188+0000 7f371af91680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T23:26:20.390 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:20.025+0000 7fc223f8b680 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-02-17T23:26:20.390 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:20.220+0000 7fc223f8b680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T23:26:20.625 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:20.392+0000 7f371af91680 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-02-17T23:26:20.890 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:20.497+0000 7fc223f8b680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T23:26:20.890 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:20.596+0000 7fc223f8b680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T23:26:21.126 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:20.686+0000 7f371af91680 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-02-17T23:26:21.126 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:20.789+0000 7f371af91680 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-02-17T23:26:21.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:21.312+0000 7fc223f8b680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T23:26:21.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:21.394+0000 7fc223f8b680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T23:26:21.640 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:21.486+0000 7fc223f8b680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T23:26:21.875 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:21.551+0000 7f371af91680 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-02-17T23:26:21.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:21.637+0000 7f371af91680 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-02-17T23:26:21.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:21.734+0000 7f371af91680 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-02-17T23:26:21.921 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:21.661+0000 7fc223f8b680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T23:26:22.186 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:21.919+0000 7fc223f8b680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T23:26:22.187 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:22.049+0000 7fc223f8b680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T23:26:22.192 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:21.919+0000 7f371af91680 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-02-17T23:26:22.442 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:22.185+0000 7fc223f8b680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:26:22.442 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:22.356+0000 7fc223f8b680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T23:26:22.473 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:22.190+0000 7f371af91680 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-02-17T23:26:22.473 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:22.329+0000 7f371af91680 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-02-17T23:26:22.747 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:22.470+0000 7f371af91680 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-02-17T23:26:22.747 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:22.656+0000 7f371af91680 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-02-17T23:26:22.748 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:22 smithi005 bash[38535]: cluster 2024-02-17T23:26:22.454205+0000 mon.a (mon.0) 11 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:26:22.748 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:22 smithi005 bash[38535]: cluster 2024-02-17T23:26:22.454286+0000 mon.a (mon.0) 12 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:26:22.748 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:22 smithi005 bash[38535]: audit 2024-02-17T23:26:22.455006+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:26:22.748 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:22 smithi005 bash[38535]: audit 2024-02-17T23:26:22.455839+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:26:22.748 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:22 smithi005 bash[38535]: audit 2024-02-17T23:26:22.456615+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:26:22.748 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:22 smithi005 bash[38535]: audit 2024-02-17T23:26:22.456845+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:26:22.748 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:22.454205+0000 mon.a (mon.0) 11 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:26:22.748 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:22.454286+0000 mon.a (mon.0) 12 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:26:22.748 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:22.455006+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:26:22.748 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:22.455839+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:26:22.749 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:22.456615+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:26:22.749 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:22.456845+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:26:22.891 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:26:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x[52649]: debug 2024-02-17T23:26:22.440+0000 7fc223f8b680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T23:26:22.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:22 smithi080 bash[35203]: cluster 2024-02-17T23:26:22.454205+0000 mon.a (mon.0) 11 : cluster [DBG] Standby manager daemon x restarted 2024-02-17T23:26:22.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:22 smithi080 bash[35203]: cluster 2024-02-17T23:26:22.454286+0000 mon.a (mon.0) 12 : cluster [DBG] Standby manager daemon x started 2024-02-17T23:26:22.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:22 smithi080 bash[35203]: audit 2024-02-17T23:26:22.455006+0000 mon.b (mon.2) 188 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-02-17T23:26:22.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:22 smithi080 bash[35203]: audit 2024-02-17T23:26:22.455839+0000 mon.b (mon.2) 189 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:26:22.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:22 smithi080 bash[35203]: audit 2024-02-17T23:26:22.456615+0000 mon.b (mon.2) 190 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-02-17T23:26:22.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:22 smithi080 bash[35203]: audit 2024-02-17T23:26:22.456845+0000 mon.b (mon.2) 191 : audit [DBG] from='mgr.? 172.21.15.80:0/974184081' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:26:23.126 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:22.745+0000 7f371af91680 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-02-17T23:26:23.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:23 smithi005 bash[38535]: cluster 2024-02-17T23:26:22.508958+0000 mon.a (mon.0) 13 : cluster [DBG] mgrmap e28: y(active, since 47s), standbys: x 2024-02-17T23:26:23.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:23 smithi005 bash[38535]: cluster 2024-02-17T23:26:22.758810+0000 mon.a (mon.0) 14 : cluster [INF] Active manager daemon y restarted 2024-02-17T23:26:23.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:23 smithi005 bash[38535]: cluster 2024-02-17T23:26:22.759118+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-02-17T23:26:23.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:23 smithi005 bash[38535]: cluster 2024-02-17T23:26:22.764973+0000 mon.a (mon.0) 16 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:26:23.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:23 smithi005 bash[38535]: cluster 2024-02-17T23:26:22.765440+0000 mon.a (mon.0) 17 : cluster [DBG] mgrmap e29: y(active, starting, since 0.00644081s), standbys: x 2024-02-17T23:26:23.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:22.508958+0000 mon.a (mon.0) 13 : cluster [DBG] mgrmap e28: y(active, since 47s), standbys: x 2024-02-17T23:26:23.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:22.758810+0000 mon.a (mon.0) 14 : cluster [INF] Active manager daemon y restarted 2024-02-17T23:26:23.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:22.759118+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-02-17T23:26:23.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:22.764973+0000 mon.a (mon.0) 16 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:26:23.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:22.765440+0000 mon.a (mon.0) 17 : cluster [DBG] mgrmap e29: y(active, starting, since 0.00644081s), standbys: x 2024-02-17T23:26:23.889 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:23 smithi080 bash[35203]: cluster 2024-02-17T23:26:22.508958+0000 mon.a (mon.0) 13 : cluster [DBG] mgrmap e28: y(active, since 47s), standbys: x 2024-02-17T23:26:23.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:23 smithi080 bash[35203]: cluster 2024-02-17T23:26:22.758810+0000 mon.a (mon.0) 14 : cluster [INF] Active manager daemon y restarted 2024-02-17T23:26:23.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:23 smithi080 bash[35203]: cluster 2024-02-17T23:26:22.759118+0000 mon.a (mon.0) 15 : cluster [INF] Activating manager daemon y 2024-02-17T23:26:23.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:23 smithi080 bash[35203]: cluster 2024-02-17T23:26:22.764973+0000 mon.a (mon.0) 16 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:26:23.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:23 smithi080 bash[35203]: cluster 2024-02-17T23:26:22.765440+0000 mon.a (mon.0) 17 : cluster [DBG] mgrmap e29: y(active, starting, since 0.00644081s), standbys: x 2024-02-17T23:26:29.075 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.767850+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.768026+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.768177+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.769427+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.769743+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.770072+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.770474+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.770725+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.770960+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.771230+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.771581+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.771872+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.772185+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:26:29.076 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.772507+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.772737+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.767850+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.768026+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.768177+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.769427+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.769743+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.770072+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.770474+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.770725+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.770960+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:26:29.077 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.771230+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:26:29.078 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.771581+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:26:29.078 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.771872+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:26:29.078 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.772185+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:26:29.078 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.772507+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:26:29.078 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.772737+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:26:29.078 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.773249+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:26:29.078 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.774052+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:26:29.078 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.775111+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-17T23:26:29.078 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.773249+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:26:29.078 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.774052+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.775111+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.775510+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.775909+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.776305+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi005"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.776720+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.777153+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.777511+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.777894+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.778319+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.778708+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.779100+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-17T23:26:29.079 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.779490+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-17T23:26:29.080 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:28.870+0000 7f36ce75d700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-02-17T23:26:29.080 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: [79B blob data] 2024-02-17T23:26:29.080 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: [78B blob data] 2024-02-17T23:26:29.080 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.775510+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-17T23:26:29.080 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.775909+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-17T23:26:29.080 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.776305+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi005"}]: dispatch 2024-02-17T23:26:29.080 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.776720+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-02-17T23:26:29.080 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.777153+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-17T23:26:29.080 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.777511+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.777894+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.778319+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.778708+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.779100+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.779490+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.779855+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.780232+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.780610+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.780989+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.781375+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.781754+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.782144+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.782533+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.782918+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-17T23:26:29.081 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.783322+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: audit 2024-02-17T23:26:28.783702+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:28 smithi005 bash[38535]: cluster 2024-02-17T23:26:28.808663+0000 mon.a (mon.0) 18 : cluster [INF] Manager daemon y is now available 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.779855+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.780232+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.780610+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.780989+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.781375+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.781754+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.782144+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.782533+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.782918+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-17T23:26:29.082 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.783322+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:26:29.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.783702+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:26:29.083 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:28.808663+0000 mon.a (mon.0) 18 : cluster [INF] Manager daemon y is now available 2024-02-17T23:26:29.083 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.767850+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:26:29.083 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.768026+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:26:29.083 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.768177+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.769427+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.769743+0000 mon.c (mon.1) 139 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.770072+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.770474+0000 mon.c (mon.1) 141 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.770725+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.770960+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.771230+0000 mon.c (mon.1) 144 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.771581+0000 mon.c (mon.1) 145 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.771872+0000 mon.c (mon.1) 146 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.772185+0000 mon.c (mon.1) 147 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.772507+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-02-17T23:26:29.084 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.772737+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.773249+0000 mon.c (mon.1) 150 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.774052+0000 mon.c (mon.1) 151 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.775111+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/config_checks"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.775510+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_crt"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.775909+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/grafana_key"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.776305+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi005"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.776720+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi080"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.777153+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.777511+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.777894+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.alertmanager"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.778319+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.grafana"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.778708+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.mgr"}]: dispatch 2024-02-17T23:26:29.085 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.779100+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.node-exporter"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.779490+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.prometheus"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.779855+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/spec.rgw.r.z"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.780232+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.780610+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.780989+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.781375+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/accessdb_v2"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.781754+0000 mon.c (mon.1) 169 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.782144+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.782533+0000 mon.c (mon.1) 171 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.782918+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/progress/completed"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.783322+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: audit 2024-02-17T23:26:28.783702+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2024-02-17T23:26:29.086 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:28 smithi080 bash[35203]: cluster 2024-02-17T23:26:28.808663+0000 mon.a (mon.0) 18 : cluster [INF] Manager daemon y is now available 2024-02-17T23:26:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:28.866741+0000 mon.a (mon.0) 19 : cluster [DBG] mgrmap e30: y(active, since 6s), standbys: x 2024-02-17T23:26:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:28.873493+0000 mgr.y (mgr.44106) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.929152+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.930602+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.971645+0000 mon.c (mon.1) 177 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:26:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.972015+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:26:30.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.976944+0000 mon.c (mon.1) 178 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:28.977309+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:29.215598+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:29.224848+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:29 smithi005 bash[38535]: cluster 2024-02-17T23:26:28.866741+0000 mon.a (mon.0) 19 : cluster [DBG] mgrmap e30: y(active, since 6s), standbys: x 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:29 smithi005 bash[38535]: cluster 2024-02-17T23:26:28.873493+0000 mgr.y (mgr.44106) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:29 smithi005 bash[38535]: audit 2024-02-17T23:26:28.929152+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:29 smithi005 bash[38535]: audit 2024-02-17T23:26:28.930602+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:29 smithi005 bash[38535]: audit 2024-02-17T23:26:28.971645+0000 mon.c (mon.1) 177 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:29 smithi005 bash[38535]: audit 2024-02-17T23:26:28.972015+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:29 smithi005 bash[38535]: audit 2024-02-17T23:26:28.976944+0000 mon.c (mon.1) 178 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:29 smithi005 bash[38535]: audit 2024-02-17T23:26:28.977309+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:26:30.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:29 smithi005 bash[38535]: audit 2024-02-17T23:26:29.215598+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:30.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:29 smithi005 bash[38535]: audit 2024-02-17T23:26:29.224848+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:29 smithi080 bash[35203]: cluster 2024-02-17T23:26:28.866741+0000 mon.a (mon.0) 19 : cluster [DBG] mgrmap e30: y(active, since 6s), standbys: x 2024-02-17T23:26:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:29 smithi080 bash[35203]: cluster 2024-02-17T23:26:28.873493+0000 mgr.y (mgr.44106) 1 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:29 smithi080 bash[35203]: audit 2024-02-17T23:26:28.929152+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:29 smithi080 bash[35203]: audit 2024-02-17T23:26:28.930602+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:29 smithi080 bash[35203]: audit 2024-02-17T23:26:28.971645+0000 mon.c (mon.1) 177 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:26:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:29 smithi080 bash[35203]: audit 2024-02-17T23:26:28.972015+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-02-17T23:26:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:29 smithi080 bash[35203]: audit 2024-02-17T23:26:28.976944+0000 mon.c (mon.1) 178 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:26:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:29 smithi080 bash[35203]: audit 2024-02-17T23:26:28.977309+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-02-17T23:26:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:29 smithi080 bash[35203]: audit 2024-02-17T23:26:29.215598+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:30.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:29 smithi080 bash[35203]: audit 2024-02-17T23:26:29.224848+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:30.771683+0000 mgr.y (mgr.44106) 2 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:30.873040+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e31: y(active, since 8s), standbys: x 2024-02-17T23:26:32.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:31 smithi005 bash[38535]: cluster 2024-02-17T23:26:30.771683+0000 mgr.y (mgr.44106) 2 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:32.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:31 smithi005 bash[38535]: cluster 2024-02-17T23:26:30.873040+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e31: y(active, since 8s), standbys: x 2024-02-17T23:26:32.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:31 smithi080 bash[35203]: cluster 2024-02-17T23:26:30.771683+0000 mgr.y (mgr.44106) 2 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:31 smithi080 bash[35203]: cluster 2024-02-17T23:26:30.873040+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e31: y(active, since 8s), standbys: x 2024-02-17T23:26:33.875 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:33 smithi080 bash[35203]: cluster 2024-02-17T23:26:32.772100+0000 mgr.y (mgr.44106) 3 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:32.772100+0000 mgr.y (mgr.44106) 3 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:33 smithi005 bash[38535]: cluster 2024-02-17T23:26:32.772100+0000 mgr.y (mgr.44106) 3 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:35.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.056030+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"879f1e7d963e\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 39856373, \"cpu_percentage\": \"1.62%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:34.053965Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:26:15.061888Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 426770432, \"cpu_percentage\": \"23.58%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:34.054144Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 116496793, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054220Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48643440, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054288Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45120225, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054352Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46263173, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054415Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45990543, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054479Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13117685, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054542Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16892559, \"cpu_percentage\": \"0.24%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054606Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39017512, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054668Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:34.054803Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:35.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.059911+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:35.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.342295+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.342742+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.343083+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.343378+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.343673+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.343949+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.344253+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.344532+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:34 smithi080 bash[35203]: audit 2024-02-17T23:26:34.344818+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.056030+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"879f1e7d963e\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 39856373, \"cpu_percentage\": \"1.62%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:34.053965Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:26:15.061888Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 426770432, \"cpu_percentage\": \"23.58%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:34.054144Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 116496793, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054220Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48643440, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054288Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45120225, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054352Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46263173, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054415Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45990543, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054479Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13117685, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054542Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16892559, \"cpu_percentage\": \"0.24%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054606Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2. 2024-02-17T23:26:35.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.056030+0000 mon.c (mon.1) 181 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"879f1e7d963e\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 39856373, \"cpu_percentage\": \"1.62%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:34.053965Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:26:15.061888Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 426770432, \"cpu_percentage\": \"23.58%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:34.054144Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"a3ec149a5abb\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 116496793, \"cpu_percentage\": \"0.81%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054220Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:15:06.248890Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48643440, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054288Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45120225, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054352Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46263173, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054415Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45990543, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054479Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13117685, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054542Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16892559, \"cpu_percentage\": \"0.24%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054606Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39017512, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054668Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:34.054803Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:35.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.059911+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:35.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.342295+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.342742+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.343083+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.343378+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.343673+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.343949+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.344253+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.344532+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:34 smithi005 bash[38535]: audit 2024-02-17T23:26:34.344818+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: 0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39017512, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054668Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:47.183272Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:34.054803Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.059911+0000 mon.a (mon.0) 23 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:35.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.342295+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.342742+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.343083+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.343378+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.343673+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.343949+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.344253+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.344532+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.344818+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.980 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.873049+0000 mon.c (mon.1) 191 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 112721920, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.870683Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 400346316, \"cpu_percentage\": \"46.92%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:34.870863Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47164948, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.870959Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43840962, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871045Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871159Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871246Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 39111884, \"cpu_percentage\": \"0.67%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871331Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14784921, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871415Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36133928, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871498Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0 2024-02-17T23:26:35.981 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:34.873049+0000 mon.c (mon.1) 191 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 112721920, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.870683Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 400346316, \"cpu_percentage\": \"46.92%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:34.870863Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47164948, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.870959Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43840962, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871045Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871159Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871246Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 39111884, \"cpu_percentage\": \"0.67%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871331Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14784921, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871415Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36133928, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871498Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40621834, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871579Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:34.871742Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:35.981 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:34.882802+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:35.981 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.148721+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.981 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.149261+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.981 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.149686+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.981 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.150088+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.981 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.150495+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.981 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.150882+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.981 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.151290+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.151680+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.152102+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.153748+0000 mon.c (mon.1) 201 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.157269+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.164064+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.165227+0000 mon.c (mon.1) 203 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.167269+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.168674+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: audit 2024-02-17T23:26:35.169566+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:35 smithi005 bash[38535]: cephadm 2024-02-17T23:26:35.170221+0000 mgr.y (mgr.44106) 5 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-02-17T23:26:35.982 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40621834, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871579Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:34.871742Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:34.882802+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.148721+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.149261+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.149686+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.150088+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.150495+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.150882+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.151290+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.151680+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.152102+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.153748+0000 mon.c (mon.1) 201 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.157269+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.164064+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:35.983 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.165227+0000 mon.c (mon.1) 203 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:35.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.167269+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:35.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.168674+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-17T23:26:35.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:35.169566+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-02-17T23:26:35.984 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:26:35.170221+0000 mgr.y (mgr.44106) 5 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-02-17T23:26:36.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:34.873049+0000 mon.c (mon.1) 191 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi080","val":"{\"daemons\": {\"mon.b\": {\"daemon_type\": \"mon\", \"daemon_id\": \"b\", \"daemon_name\": \"mon.b\", \"hostname\": \"smithi080\", \"container_id\": \"627dfcd31839\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 112721920, \"cpu_percentage\": \"1.02%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.870683Z\", \"created\": \"2024-02-17T23:15:26.652314Z\", \"started\": \"2024-02-17T23:15:26.687297Z\"}, \"mgr.x\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"x\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.x\", \"hostname\": \"smithi080\", \"container_id\": \"4db9cf00b8fa\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 400346316, \"cpu_percentage\": \"46.92%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:34.870863Z\", \"created\": \"2024-02-17T23:15:43.142949Z\", \"started\": \"2024-02-17T23:26:03.159952Z\"}, \"osd.4\": {\"daemon_type\": \"osd\", \"daemon_id\": \"4\", \"daemon_name\": \"osd.4\", \"hostname\": \"smithi080\", \"container_id\": \"e7700ac2ac98\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 47164948, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.870959Z\", \"created\": \"2024-02-17T23:17:18.964823Z\", \"started\": \"2024-02-17T23:17:22.809211Z\"}, \"osd.5\": {\"daemon_type\": \"osd\", \"daemon_id\": \"5\", \"daemon_name\": \"osd.5\", \"hostname\": \"smithi080\", \"container_id\": \"6d47425e8cfa\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43840962, \"cpu_percentage\": \"0.52%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871045Z\", \"created\": \"2024-02-17T23:17:37.782405Z\", \"started\": \"2024-02-17T23:18:00.964544Z\"}, \"osd.6\": {\"daemon_type\": \"osd\", \"daemon_id\": \"6\", \"daemon_name\": \"osd.6\", \"hostname\": \"smithi080\", \"container_id\": \"c392aabd1bed\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 43484446, \"cpu_percentage\": \"0.51%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871159Z\", \"created\": \"2024-02-17T23:18:02.056866Z\", \"started\": \"2024-02-17T23:18:05.879274Z\"}, \"osd.7\": {\"daemon_type\": \"osd\", \"daemon_id\": \"7\", \"daemon_name\": \"osd.7\", \"hostname\": \"smithi080\", \"container_id\": \"74ef9ff13606\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46965719, \"cpu_percentage\": \"0.54%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871246Z\", \"created\": \"2024-02-17T23:18:22.301417Z\", \"started\": \"2024-02-17T23:18:24.312602Z\"}, \"prometheus.a\": {\"daemon_type\": \"prometheus\", \"daemon_id\": \"a\", \"daemon_name\": \"prometheus.a\", \"hostname\": \"smithi080\", \"container_id\": \"10249a176bf4\", \"container_image_id\": \"2a72b385beafd2b3685ad337d14d23f6851f0ff335c5cd9a04c692b3eb846196\", \"container_image_name\": \"docker.io/prom/prometheus:latest\", \"container_image_digests\": [\"docker.io/prom/prometheus@sha256:beb5e30ffba08d9ae8a7961b9a2145fc8af6296ff2a4f463df7cd722fcbfc789\", \"docker.io/prom/prometheus@sha256:d55cb26ce61c789179cd50fba2f11085424c73cbbabed561a3c2248ca12eb6ec\"], \"memory_usage\": 39111884, \"cpu_percentage\": \"0.67%\", \"version\": \"2.49.1\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871331Z\", \"created\": \"2024-02-17T23:18:52.289751Z\", \"started\": \"2024-02-17T23:25:10.672439Z\"}, \"node-exporter.b\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"b\", \"daemon_name\": \"node-exporter.b\", \"hostname\": \"smithi080\", \"container_id\": \"b8a0e0cba51e\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 14784921, \"cpu_percentage\": \"0.34%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871415Z\", \"created\": \"2024-02-17T23:18:55.150687Z\", \"started\": \"2024-02-17T23:19:03.916708Z\"}, \"grafana.a\": {\"daemon_type\": \"grafana\", \"daemon_id\": \"a\", \"daemon_name\": \"grafana.a\", \"hostname\": \"smithi080\", \"container_id\": \"7e1204fc1c45\", \"container_image_id\": \"87a51ecf0b1c9a7b187b21c1b071425dafea0d765a96d5bc371c791169b3d7f4\", \"container_image_name\": \"docker.io/ceph/ceph-grafana:latest\", \"container_image_digests\": [\"docker.io/ceph/ceph-grafana@sha256:f5ec32c0cf2585fc34af7f6be4d829a1ba6fe9c8eac6f4593d62f258dd718a8a\"], \"memory_usage\": 36133928, \"cpu_percentage\": \"0.46%\", \"version\": \"6.6.2\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871498Z\", \"created\": \"2024-02-17T23:19:34.269818Z\", \"started\": \"2024-02-17T23:19:34.380225Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi080.qdwuig\", \"daemon_name\": \"rgw.r.z.smithi080.qdwuig\", \"hostname\": \"smithi080\", \"container_id\": \"0b872ec67795\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 40621834, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.871579Z\", \"created\": \"2024-02-17T23:20:42.486301Z\", \"started\": \"2024-02-17T23:20:42.517492Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"Insufficient space (<5GB) on vgs\", \"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPEDMD400G4\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 400088457216.0, \"human_readable_size\": \"372.61 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635074Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"7\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"14e72964-304a-427b-bfcf-cd0f7188c969\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"4TQArn-NAqz-nKkW-PAW1-FX4f-MIut-2bMywU\"}, {\"name\": \"lv_2\", \"osd_id\": \"6\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"0ac05a2a-eebb-480e-aed6-dfa0c7cc9399\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"GIRPEt-cgsB-I4CW-8ZFe-E4Bt-0cV2-8gVzp0\"}, {\"name\": \"lv_3\", \"osd_id\": \"5\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"80950c10-2920-43c8-ad6c-f4b013db0c99\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"FGWNIZ-cBvt-ZMjK-XMXb-nWIa-ihUl-xXKTZe\"}, {\"name\": \"lv_4\", \"osd_id\": \"4\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"1155a36f-e150-4d31-aac3-2ac9081cd6aa\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"BAChbD-EAds-snvs-QUiH-ZyxH-MVvQ-yQzzqX\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPEDMD400G4_PHFT6204014T400BGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN06\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.635082Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W5R0PW\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:24:57.662153Z\"}, \"mgr.x\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:50.066755Z\"}, \"osd.4\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:17.345263Z\"}, \"osd.5\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:55.192265Z\"}, \"osd.6\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:59.070495Z\"}, \"osd.7\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:20.459933Z\"}, \"prometheus.a\": {\"deps\": [\"9283\", \"alertmanager.a\", \"mgr.x\", \"mgr.y\", \"node-exporter.a\", \"node-exporter.b\"], \"last_config\": \"2024-02-17T23:24:59.286606Z\"}, \"node-exporter.b\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:54.698770Z\"}, \"grafana.a\": {\"deps\": [\"prometheus.a\"], \"last_config\": \"2024-02-17T23:19:16.499845Z\"}, \"rgw.r.z.smithi080.qdwuig\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:40.691234Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:34.871742Z\", \"last_device_update\": \"2024-02-17T23:18:28.954439Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:25:29.105514Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:36.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:34.882802+0000 mon.a (mon.0) 24 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:36.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.148721+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:36.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.149261+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.149686+0000 mon.c (mon.1) 194 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.150088+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.150495+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.150882+0000 mon.c (mon.1) 197 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.151290+0000 mon.c (mon.1) 198 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.151680+0000 mon.c (mon.1) 199 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.152102+0000 mon.c (mon.1) 200 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd","key": "osd_memory_target_autotune"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.153748+0000 mon.c (mon.1) 201 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.157269+0000 mon.a (mon.0) 25 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.164064+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.165227+0000 mon.c (mon.1) 203 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.167269+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.168674+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: audit 2024-02-17T23:26:35.169566+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-02-17T23:26:36.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:35 smithi080 bash[35203]: cephadm 2024-02-17T23:26:35.170221+0000 mgr.y (mgr.44106) 5 : cephadm [INF] Upgrade: It appears safe to stop mon.c 2024-02-17T23:26:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:36 smithi005 bash[38535]: audit 2024-02-17T23:26:36.671759+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.c"}]: dispatch 2024-02-17T23:26:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:36 smithi005 bash[38535]: audit 2024-02-17T23:26:36.675613+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:36 smithi005 bash[38535]: audit 2024-02-17T23:26:36.677443+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:26:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:36 smithi005 bash[38535]: audit 2024-02-17T23:26:36.678145+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:26:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:36 smithi005 bash[38535]: audit 2024-02-17T23:26:36.678787+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:26:37.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:36 smithi005 bash[38535]: audit 2024-02-17T23:26:36.679828+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-17T23:26:37.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:36.671759+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.c"}]: dispatch 2024-02-17T23:26:37.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:36.675613+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:37.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:36.677443+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:26:37.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:36.678145+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:26:37.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:36.678787+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:26:37.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:36.679828+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-17T23:26:37.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:36 smithi080 bash[35203]: audit 2024-02-17T23:26:36.671759+0000 mon.c (mon.1) 207 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.c"}]: dispatch 2024-02-17T23:26:37.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:36 smithi080 bash[35203]: audit 2024-02-17T23:26:36.675613+0000 mon.a (mon.0) 26 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:37.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:36 smithi080 bash[35203]: audit 2024-02-17T23:26:36.677443+0000 mon.c (mon.1) 208 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:26:37.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:36 smithi080 bash[35203]: audit 2024-02-17T23:26:36.678145+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:26:37.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:36 smithi080 bash[35203]: audit 2024-02-17T23:26:36.678787+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:26:37.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:36 smithi080 bash[35203]: audit 2024-02-17T23:26:36.679828+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-17T23:26:37.437 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:26:38.095 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (100s) 4s ago 7m 16.1M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (7m) 3s ago 7m 34.4M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (34s) 3s ago 10m 381M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (69s) 4s ago 12m 407M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (23s) 4s ago 12m 38.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (11m) 3s ago 11m 107M 2048M 15.2.0 204a01f9b0b6 627dfcd31839 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (11m) 4s ago 11m 111M 2048M 15.2.0 204a01f9b0b6 a3ec149a5abb 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (7m) 4s ago 7m 12.5M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (7m) 3s ago 7m 14.0M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (10m) 4s ago 10m 46.3M 4096M 15.2.0 204a01f9b0b6 e7811399e7c1 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (10m) 4s ago 10m 43.0M 4096M 15.2.0 204a01f9b0b6 61f8f838512a 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (9m) 4s ago 9m 44.1M 4096M 15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:26:38.096 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (9m) 4s ago 9m 43.8M 4096M 15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:26:38.097 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (9m) 3s ago 9m 44.9M 4096M 15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:26:38.097 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (8m) 3s ago 9m 41.8M 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:26:38.097 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (8m) 3s ago 8m 41.4M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:26:38.097 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (8m) 3s ago 8m 44.7M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:26:38.097 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (87s) 3s ago 7m 37.2M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:26:38.097 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (5m) 4s ago 5m 37.2M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:26:38.097 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (5m) 3s ago 5m 38.7M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:26:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:37 smithi080 bash[35203]: cephadm 2024-02-17T23:26:36.671325+0000 mgr.y (mgr.44106) 6 : cephadm [INF] Upgrade: Updating mon.c 2024-02-17T23:26:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:37 smithi080 bash[35203]: cephadm 2024-02-17T23:26:36.679413+0000 mgr.y (mgr.44106) 7 : cephadm [INF] Deploying daemon mon.c on smithi005 2024-02-17T23:26:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:37 smithi080 bash[35203]: cluster 2024-02-17T23:26:36.773195+0000 mgr.y (mgr.44106) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:38.233 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:26:36.671325+0000 mgr.y (mgr.44106) 6 : cephadm [INF] Upgrade: Updating mon.c 2024-02-17T23:26:38.233 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:26:36.679413+0000 mgr.y (mgr.44106) 7 : cephadm [INF] Deploying daemon mon.c on smithi005 2024-02-17T23:26:38.233 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:36.773195+0000 mgr.y (mgr.44106) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:38.233 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:37 smithi005 bash[38535]: cephadm 2024-02-17T23:26:36.671325+0000 mgr.y (mgr.44106) 6 : cephadm [INF] Upgrade: Updating mon.c 2024-02-17T23:26:38.233 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:37 smithi005 bash[38535]: cephadm 2024-02-17T23:26:36.679413+0000 mgr.y (mgr.44106) 7 : cephadm [INF] Deploying daemon mon.c on smithi005 2024-02-17T23:26:38.233 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:37 smithi005 bash[38535]: cluster 2024-02-17T23:26:36.773195+0000 mgr.y (mgr.44106) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:38.508 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:26:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:26:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2024-02-17T23:26:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 1 2024-02-17T23:26:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:26:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:26:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:26:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:26:38.508 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 12, 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:26:38.509 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:26:38.534 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:38 smithi005 systemd[1]: Stopping Ceph mon.c for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:26:38.534 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:38 smithi005 bash[38535]: debug 2024-02-17T23:26:38.531+0000 7f4065000700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:26:38.535 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:38 smithi005 bash[38535]: debug 2024-02-17T23:26:38.531+0000 7f4065000700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-02-17T23:26:38.843 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:26:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:26:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:26:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:26:38.843 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:26:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr" 2024-02-17T23:26:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:26:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "3/20 daemons upgraded", 2024-02-17T23:26:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mon daemons", 2024-02-17T23:26:38.844 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:26:38.844 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:26:39.484 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:39 smithi005 bash[61780]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon.c 2024-02-17T23:26:40.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:39 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.c.service: Succeeded. 2024-02-17T23:26:40.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:39 smithi005 systemd[1]: Stopped Ceph mon.c for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:26:40.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 systemd[1]: Starting Ceph mon.c for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:26:40.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.593+0000 7f216114c880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-17T23:26:40.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.593+0000 7f216114c880 0 ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable), process ceph-mon, pid 7 2024-02-17T23:26:40.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.593+0000 7f216114c880 0 pidfile_write: ignore empty --pid-file 2024-02-17T23:26:40.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 0 load: jerasure load: lrc load: isa 2024-02-17T23:26:40.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: RocksDB version: 6.8.1 2024-02-17T23:26:40.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-17T23:26:40.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Compile date Feb 17 2024 2024-02-17T23:26:40.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: DB SUMMARY 2024-02-17T23:26:40.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: CURRENT file: CURRENT 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 824 Bytes 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 3, files: 000022.sst 000023.sst 000025.sst 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000024.log size: 4492929 ; 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.error_if_exists: 0 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.create_if_missing: 0 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.paranoid_checks: 1 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.env: 0x559ebb65e080 2024-02-17T23:26:40.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.fs: Posix File System 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.info_log: 0x559ebd916260 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.statistics: (nil) 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.use_fsync: 0 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.max_log_file_size: 0 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.allow_fallocate: 1 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.use_direct_reads: 0 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-17T23:26:40.879 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.db_log_dir: 2024-02-17T23:26:40.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2024-02-17T23:26:40.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-17T23:26:40.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.max_subcompactions: 1 2024-02-17T23:26:40.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.max_background_flushes: -1 2024-02-17T23:26:40.880 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-17T23:26:40.882 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-17T23:26:40.882 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-17T23:26:40.882 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-17T23:26:40.882 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-17T23:26:40.882 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.write_buffer_manager: 0x559ebe608360 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.unordered_write: 0 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-17T23:26:40.883 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.row_cache: None 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.wal_filter: None 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.preserve_deletes: 0 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.two_write_queues: 0 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.atomic_flush: 0 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.log_readahead_size: 0 2024-02-17T23:26:40.884 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.max_background_jobs: 2 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.max_background_compactions: -1 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.max_open_files: -1 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-17T23:26:40.885 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Compression algorithms supported: 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: kZSTD supported: 0 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: kXpressCompression supported: 0 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: kLZ4Compression supported: 1 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: kBZip2Compression supported: 0 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: kZlibCompression supported: 1 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: kSnappyCompression supported: 1 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.598+0000 7f216114c880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-02-17T23:26:40.886 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.merge_operator: 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_filter: None 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559ebd8bbd10) 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cache_index_and_filter_blocks: 1 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: pin_top_level_index_and_filter: 1 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: index_type: 0 2024-02-17T23:26:40.887 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: data_block_index_type: 0 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: index_shortening: 1 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: data_block_hash_table_util_ratio: 0.750000 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: hash_index_allow_collision: 1 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: checksum: 1 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: no_block_cache: 0 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: block_cache: 0x559ebd8f0f10 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: block_cache_name: BinnedLRUCache 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: block_cache_options: 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: capacity : 536870912 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: num_shard_bits : 4 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: strict_capacity_limit : 0 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: high_pri_pool_ratio: 0.000 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: block_cache_compressed: (nil) 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: persistent_cache: (nil) 2024-02-17T23:26:40.888 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: block_size: 4096 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: block_size_deviation: 10 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: block_restart_interval: 16 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: index_block_restart_interval: 1 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: metadata_block_size: 4096 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: partition_filters: 0 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: use_delta_encoding: 1 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: whole_key_filtering: 1 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: verify_compression: 0 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: read_amp_bytes_per_bit: 0 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: format_version: 2 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: enable_index_compression: 1 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: block_align: 0 2024-02-17T23:26:40.889 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compression: NoCompression 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.num_levels: 7 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-17T23:26:40.890 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-17T23:26:40.891 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-17T23:26:40.892 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-17T23:26:40.893 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.table_properties_collectors: 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.inplace_update_support: 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.bloom_locality: 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.max_successive_merges: 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.ttl: 2592000 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 27, last_sequence is 10944, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-17T23:26:40.894 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.599+0000 7f216114c880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 24 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.600+0000 7f216114c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708212400601133, "job": 1, "event": "recovery_started", "log_files": [24]} 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.600+0000 7f216114c880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #24 mode 2 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.604+0000 7f216114c880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.608+0000 7f216114c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708212400609145, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 2983349, "table_properties": {"data_size": 2980109, "index_size": 2098, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 325, "raw_key_size": 2385, "raw_average_key_size": 21, "raw_value_size": 2976681, "raw_average_value_size": 26577, "num_data_blocks": 67, "num_entries": 112, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708212400, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.608+0000 7f216114c880 4 rocksdb: [version_set.cc:3826] Creating manifest 28 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.608+0000 7f216114c880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708212400609603, "job": 1, "event": "recovery_finished"} 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.609+0000 7f216114c880 4 rocksdb: DB pointer 0x559ebd9b9800 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.609+0000 7f2147f3e700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.609+0000 7f2147f3e700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ** DB Stats ** 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:26:40.895 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ** Compaction Stats [default] ** 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: L0 2/0 23.07 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 740.0 0.00 0.00 1 0.004 0 0 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: L6 2/0 65.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:26:40.896 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Sum 4/0 88.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 740.0 0.00 0.00 1 0.004 0 0 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 740.0 0.00 0.00 1 0.004 0 0 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ** Compaction Stats [default] ** 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 740.0 0.00 0.00 1 0.004 0 0 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Flush(GB): cumulative 0.003, interval 0.003 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:26:40.897 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Cumulative compaction: 0.00 GB write, 270.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Interval compaction: 0.00 GB write, 270.37 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ** Compaction Stats [default] ** 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: L0 2/0 23.07 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 740.0 0.00 0.00 1 0.004 0 0 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: L6 2/0 65.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Sum 4/0 88.13 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 740.0 0.00 0.00 1 0.004 0 0 2024-02-17T23:26:40.898 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ** Compaction Stats [default] ** 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 740.0 0.00 0.00 1 0.004 0 0 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Flush(GB): cumulative 0.003, interval 0.000 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Cumulative compaction: 0.00 GB write, 269.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:40.899 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.610+0000 7f216114c880 0 starting mon.c rank 1 at public addrs [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] at bind addrs [v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.611+0000 7f216114c880 1 mon.c@-1(???) e3 preinit fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.611+0000 7f216114c880 0 mon.c@-1(???).mds e1 new map 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.611+0000 7f216114c880 0 mon.c@-1(???).mds e1 print_map 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: e1 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: legacy client fscid: -1 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: No filesystems configured 2024-02-17T23:26:40.900 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: 2024-02-17T23:26:40.901 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.611+0000 7f216114c880 0 mon.c@-1(???).osd e66 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-17T23:26:40.901 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.611+0000 7f216114c880 0 mon.c@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:26:40.901 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.611+0000 7f216114c880 0 mon.c@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:26:40.901 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.611+0000 7f216114c880 0 mon.c@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:26:40.901 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:26:36.671325+0000 mgr.y (mgr.44106) 6 : cephadm [INF] Upgrade: Updating mon.c 2024-02-17T23:26:40.901 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:26:36.679413+0000 mgr.y (mgr.44106) 7 : cephadm [INF] Deploying daemon mon.c on smithi005 2024-02-17T23:26:40.901 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:36.773195+0000 mgr.y (mgr.44106) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:40.901 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:26:40.611+0000 7f216114c880 1 mon.c@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-02-17T23:26:40.901 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 bash[61992]: 4e38df8f35b020e7be3db64e33a5f7887a1b9ac1e2670d03091be38f8f08f30b 2024-02-17T23:26:40.901 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:40 smithi005 systemd[1]: Started Ceph mon.c for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:26:43.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:38.773572+0000 mgr.y (mgr.44106) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:43.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:38.841775+0000 mgr.y (mgr.44106) 13 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:43.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:38.773572+0000 mgr.y (mgr.44106) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:43.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:38.841775+0000 mgr.y (mgr.44106) 13 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:43.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:40.701179+0000 mon.b (mon.2) 195 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"879f1e7d963e\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 39856373, \"cpu_percentage\": \"1.62%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:34.053965Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:26:15.061888Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 426770432, \"cpu_percentage\": \"23.58%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:34.054144Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48643440, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054288Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45120225, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054352Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46263173, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054415Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45990543, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054479Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13117685, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054542Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16892559, \"cpu_percentage\": \"0.24%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:26:34.054606Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39017512, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054668Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:36.679309Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:40.774140+0000 mgr.y (mgr.44106) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:40.819122+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:41.885824+0000 mon.a (mon.0) 28 : cluster [INF] mon.a calling monitor election 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:41.899852+0000 mon.a (mon.0) 29 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:41.905609+0000 mon.a (mon.0) 30 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:41.918734+0000 mon.a (mon.0) 31 : cluster [DBG] fsmap 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:41.918781+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:41.919203+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e31: y(active, since 19s), standbys: x 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:41.919364+0000 mon.a (mon.0) 34 : cluster [INF] overall HEALTH_OK 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:41.923374+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.44106 ' entity='' 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:41.924746+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:43.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:41.926657+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:40.701179+0000 mon.b (mon.2) 195 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"879f1e7d963e\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 39856373, \"cpu_percentage\": \"1.62%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:34.053965Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:26:15.061888Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 426770432, \"cpu_percentage\": \"23.58%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:34.054144Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48643440, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054288Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45120225, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054352Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46263173, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054415Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45990543, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054479Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13117685, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054542Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16892559, \"cpu_percentage\": \"0.24%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:26:34.054606Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39017512, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054668Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:36.679309Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:40.774140+0000 mgr.y (mgr.44106) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:40.819122+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:41.885824+0000 mon.a (mon.0) 28 : cluster [INF] mon.a calling monitor election 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:41.899852+0000 mon.a (mon.0) 29 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:41.905609+0000 mon.a (mon.0) 30 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:41.918734+0000 mon.a (mon.0) 31 : cluster [DBG] fsmap 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:41.918781+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:41.919203+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e31: y(active, since 19s), standbys: x 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:41.919364+0000 mon.a (mon.0) 34 : cluster [INF] overall HEALTH_OK 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:41.923374+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.44106 ' entity='' 2024-02-17T23:26:43.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:41.924746+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:43.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:41.926657+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:43.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: cluster 2024-02-17T23:26:38.773572+0000 mgr.y (mgr.44106) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:43.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: audit 2024-02-17T23:26:38.841775+0000 mgr.y (mgr.44106) 13 : audit [DBG] from='client.44142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:26:43.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: audit 2024-02-17T23:26:40.701179+0000 mon.b (mon.2) 195 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"879f1e7d963e\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 39856373, \"cpu_percentage\": \"1.62%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:34.053965Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:26:15.061888Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 426770432, \"cpu_percentage\": \"23.58%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:34.054144Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"status\": 2, \"status_desc\": \"starting\", \"is_active\": false, \"ports\": []}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 48643440, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054288Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45120225, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054352Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 46263173, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054415Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 45990543, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054479Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\", \"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\"], \"memory_usage\": 13117685, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054542Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16892559, \"cpu_percentage\": \"0.24%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": true, \"last_refresh\": \"2024-02-17T23:26:34.054606Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\", \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\"], \"memory_usage\": 39017512, \"cpu_percentage\": \"0.17%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:34.054668Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:36.679309Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:43.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: cluster 2024-02-17T23:26:40.774140+0000 mgr.y (mgr.44106) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:43.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: cluster 2024-02-17T23:26:40.819122+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2024-02-17T23:26:43.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: cluster 2024-02-17T23:26:41.885824+0000 mon.a (mon.0) 28 : cluster [INF] mon.a calling monitor election 2024-02-17T23:26:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: cluster 2024-02-17T23:26:41.899852+0000 mon.a (mon.0) 29 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:26:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: cluster 2024-02-17T23:26:41.905609+0000 mon.a (mon.0) 30 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:26:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: cluster 2024-02-17T23:26:41.918734+0000 mon.a (mon.0) 31 : cluster [DBG] fsmap 2024-02-17T23:26:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: cluster 2024-02-17T23:26:41.918781+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:26:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: cluster 2024-02-17T23:26:41.919203+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e31: y(active, since 19s), standbys: x 2024-02-17T23:26:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: cluster 2024-02-17T23:26:41.919364+0000 mon.a (mon.0) 34 : cluster [INF] overall HEALTH_OK 2024-02-17T23:26:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: audit 2024-02-17T23:26:41.923374+0000 mon.a (mon.0) 35 : audit [INF] from='mgr.44106 ' entity='' 2024-02-17T23:26:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: audit 2024-02-17T23:26:41.924746+0000 mon.b (mon.2) 196 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:42 smithi080 bash[35203]: audit 2024-02-17T23:26:41.926657+0000 mon.b (mon.2) 197 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:44.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:42.774620+0000 mgr.y (mgr.44106) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:44.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:42.774620+0000 mgr.y (mgr.44106) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:44.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:43 smithi080 bash[35203]: cluster 2024-02-17T23:26:42.774620+0000 mgr.y (mgr.44106) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:45.875 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:45.616+0000 7f36ce75d700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-02-17T23:26:46.206 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:44.775389+0000 mgr.y (mgr.44106) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:46.206 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:44.775389+0000 mgr.y (mgr.44106) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:45 smithi080 bash[35203]: cluster 2024-02-17T23:26:44.775389+0000 mgr.y (mgr.44106) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:46 smithi080 bash[35203]: audit 2024-02-17T23:26:46.372947+0000 mon.b (mon.2) 198 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"879f1e7d963e\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 43117445, \"cpu_percentage\": \"1.87%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:46.370875Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:26:15.061888Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 432852172, \"cpu_percentage\": \"19.86%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:46.371019Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"4e38df8f35b0\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 21820866, \"cpu_percentage\": \"4.56%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:46.371100Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:26:40.170971Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48958013, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371169Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45172654, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371235Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371299Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45969571, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371363Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13117685, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371426Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16892559, \"cpu_percentage\": \"0.25%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371488Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39195770, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371550Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:36.679309Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:46.371663Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:46 smithi080 bash[35203]: audit 2024-02-17T23:26:46.376811+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:47.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:46 smithi080 bash[35203]: audit 2024-02-17T23:26:46.380051+0000 mon.b (mon.2) 199 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:47.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:46 smithi080 bash[35203]: audit 2024-02-17T23:26:46.382637+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:47.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:46 smithi080 bash[35203]: audit 2024-02-17T23:26:46.387943+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:47.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:46 smithi080 bash[35203]: audit 2024-02-17T23:26:46.388993+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:47.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:46 smithi080 bash[35203]: audit 2024-02-17T23:26:46.390626+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:47.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:46 smithi080 bash[35203]: audit 2024-02-17T23:26:46.391725+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-17T23:26:47.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:46 smithi080 bash[35203]: audit 2024-02-17T23:26:46.392439+0000 mon.b (mon.2) 204 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-02-17T23:26:47.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:46.372947+0000 mon.b (mon.2) 198 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"879f1e7d963e\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 43117445, \"cpu_percentage\": \"1.87%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:46.370875Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:26:15.061888Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 432852172, \"cpu_percentage\": \"19.86%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:46.371019Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"4e38df8f35b0\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 21820866, \"cpu_percentage\": \"4.56%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:46.371100Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:26:40.170971Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48958013, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371169Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45172654, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371235Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371299Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45969571, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371363Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13117685, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371426Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16892559, \"cpu_percentage\": \"0.25%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371488Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [ 2024-02-17T23:26:47.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: \"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39195770, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371550Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:36.679309Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:46.371663Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:47.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:46.376811+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:47.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:46.380051+0000 mon.b (mon.2) 199 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:47.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:46.382637+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:47.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:46.387943+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:47.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:46.388993+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:47.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:46.390626+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:47.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:46.391725+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-17T23:26:47.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:46.392439+0000 mon.b (mon.2) 204 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-02-17T23:26:47.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:46.372947+0000 mon.b (mon.2) 198 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/host.smithi005","val":"{\"daemons\": {\"mon.a\": {\"daemon_type\": \"mon\", \"daemon_id\": \"a\", \"service_name\": \"mon\", \"daemon_name\": \"mon.a\", \"hostname\": \"smithi005\", \"container_id\": \"879f1e7d963e\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 43117445, \"cpu_percentage\": \"1.87%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:46.370875Z\", \"created\": \"2024-02-17T23:13:42.568170Z\", \"started\": \"2024-02-17T23:26:15.061888Z\"}, \"mgr.y\": {\"daemon_type\": \"mgr\", \"daemon_id\": \"y\", \"service_name\": \"mgr\", \"daemon_name\": \"mgr.y\", \"hostname\": \"smithi005\", \"container_id\": \"5130266792fb\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 432852172, \"cpu_percentage\": \"19.86%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [8443], \"last_refresh\": \"2024-02-17T23:26:46.371019Z\", \"created\": \"2024-02-17T23:13:49.724025Z\", \"started\": \"2024-02-17T23:25:28.266142Z\"}, \"mon.c\": {\"daemon_type\": \"mon\", \"daemon_id\": \"c\", \"service_name\": \"mon\", \"daemon_name\": \"mon.c\", \"hostname\": \"smithi005\", \"container_id\": \"4e38df8f35b0\", \"container_image_id\": \"823b921721f579487e02cd293080702537bcba9f4f96b9041a06d7563de513aa\", \"container_image_name\": \"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\", \"container_image_digests\": [\"quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9\"], \"memory_usage\": 21820866, \"cpu_percentage\": \"4.56%\", \"version\": \"16.2.14-548-g81bd20d6\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"ports\": [], \"last_refresh\": \"2024-02-17T23:26:46.371100Z\", \"created\": \"2024-02-17T23:15:06.215469Z\", \"started\": \"2024-02-17T23:26:40.170971Z\"}, \"osd.0\": {\"daemon_type\": \"osd\", \"daemon_id\": \"0\", \"daemon_name\": \"osd.0\", \"hostname\": \"smithi005\", \"container_id\": \"e7811399e7c1\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 48958013, \"cpu_percentage\": \"0.50%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371169Z\", \"created\": \"2024-02-17T23:16:01.235348Z\", \"started\": \"2024-02-17T23:16:03.415063Z\"}, \"osd.1\": {\"daemon_type\": \"osd\", \"daemon_id\": \"1\", \"daemon_name\": \"osd.1\", \"hostname\": \"smithi005\", \"container_id\": \"61f8f838512a\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45172654, \"cpu_percentage\": \"0.53%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371235Z\", \"created\": \"2024-02-17T23:16:21.463936Z\", \"started\": \"2024-02-17T23:16:23.451785Z\"}, \"osd.2\": {\"daemon_type\": \"osd\", \"daemon_id\": \"2\", \"daemon_name\": \"osd.2\", \"hostname\": \"smithi005\", \"container_id\": \"d35b8f2f65a2\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 46294630, \"cpu_percentage\": \"0.40%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371299Z\", \"created\": \"2024-02-17T23:16:41.581525Z\", \"started\": \"2024-02-17T23:16:43.921834Z\"}, \"osd.3\": {\"daemon_type\": \"osd\", \"daemon_id\": \"3\", \"daemon_name\": \"osd.3\", \"hostname\": \"smithi005\", \"container_id\": \"53d1e133da0b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_name\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 45969571, \"cpu_percentage\": \"0.56%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371363Z\", \"created\": \"2024-02-17T23:17:03.071087Z\", \"started\": \"2024-02-17T23:17:05.653800Z\"}, \"node-exporter.a\": {\"daemon_type\": \"node-exporter\", \"daemon_id\": \"a\", \"daemon_name\": \"node-exporter.a\", \"hostname\": \"smithi005\", \"container_id\": \"f95c680110b8\", \"container_image_id\": \"72c9c208898624938c9e4183d6686ea4a5fd3f912bc29bc3f00147924c521a3e\", \"container_image_name\": \"docker.io/prom/node-exporter:latest\", \"container_image_digests\": [\"docker.io/prom/node-exporter@sha256:52a6f10ff10238979c365c06dbed8ad5cd1645c41780dc08ff813adacfb2341e\", \"docker.io/prom/node-exporter@sha256:4cb2b9019f1757be8482419002cb7afe028fdba35d47958829e4cfeaf6246d80\"], \"memory_usage\": 13117685, \"cpu_percentage\": \"0.36%\", \"version\": \"1.7.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371426Z\", \"created\": \"2024-02-17T23:18:55.715789Z\", \"started\": \"2024-02-17T23:19:07.859907Z\"}, \"alertmanager.a\": {\"daemon_type\": \"alertmanager\", \"daemon_id\": \"a\", \"daemon_name\": \"alertmanager.a\", \"hostname\": \"smithi005\", \"container_id\": \"8b0542fa0b14\", \"container_image_id\": \"9f27df16978d8a27fc102b72eae63c6e9cd6d4e1675c414ec79df7f280868098\", \"container_image_name\": \"docker.io/prom/alertmanager:latest\", \"container_image_digests\": [\"docker.io/prom/alertmanager@sha256:361db356b33041437517f1cd298462055580585f26555c317df1a3caf2868552\", \"docker.io/prom/alertmanager@sha256:b97390a5b2b52cf4dd66098a091ac0575d18fbf35acf2501fb0f180e3488ad15\"], \"memory_usage\": 16892559, \"cpu_percentage\": \"0.25%\", \"version\": \"0.26.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371488Z\", \"created\": \"2024-02-17T23:19:16.461367Z\", \"started\": \"2024-02-17T23:24:57.735557Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"daemon_type\": \"rgw\", \"daemon_id\": \"r.z.smithi005.dlhvju\", \"daemon_name\": \"rgw.r.z.smithi005.dlhvju\", \"hostname\": \"smithi005\", \"container_id\": \"5000712a390b\", \"container_image_id\": \"204a01f9b0b6710dd0c0af7f37ce7139c47ff0f0105d778d7104c69282dfbbf1\", \"container_image_n 2024-02-17T23:26:47.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: ame\": \"docker.io/ceph/ceph:v15.2.0\", \"container_image_digests\": [\"docker.io/ceph/ceph@sha256:54b064d6a616656497df507997f8cd47f96ec7cc137f18b69f74ea03a1467c60\", \"docker.io/ceph/ceph@sha256:1cc9b824e1b076cdff52a9aa3f0cc8557d879fb2fbbba0cafed970aca59a3992\"], \"memory_usage\": 39195770, \"cpu_percentage\": \"0.18%\", \"version\": \"15.2.0\", \"status\": 1, \"status_desc\": \"running\", \"is_active\": false, \"last_refresh\": \"2024-02-17T23:26:46.371550Z\", \"created\": \"2024-02-17T23:20:45.051564Z\", \"started\": \"2024-02-17T23:20:45.083187Z\"}}, \"devices\": [{\"ceph_device\": null, \"rejected_reasons\": [\"LVM detected\", \"locked\"], \"available\": false, \"path\": \"/dev/nvme0n1\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"\", \"model\": \"INTEL SSDPED1D480GA\", \"rev\": \"\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"512\", \"rotational\": \"0\", \"nr_requests\": \"1023\", \"scheduler_mode\": \"none\", \"partitions\": {}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 480103981056.0, \"human_readable_size\": \"447.13 GB\", \"path\": \"/dev/nvme0n1\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634011Z\", \"lvs\": [{\"name\": \"lv_1\", \"osd_id\": \"3\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"090543ef-5784-4b6c-a6b8-456f4c98440c\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"8CD4Up-1YER-ody5-Q8lg-qRMK-w0so-dF8TyH\"}, {\"name\": \"lv_2\", \"osd_id\": \"2\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"00b874d3-a65b-4855-bf32-106d604add53\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"i2Ue9u-9SVs-EUmD-skDm-xkZ5-GyVg-R0ut9P\"}, {\"name\": \"lv_3\", \"osd_id\": \"1\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"53145211-95db-47c4-946c-d258f1bd2277\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"lZypkj-GkbW-waAj-vgIh-d7wA-SCDo-kRJsNJ\"}, {\"name\": \"lv_4\", \"osd_id\": \"0\", \"cluster_name\": \"ceph\", \"type\": \"block\", \"osd_fsid\": \"7c17641c-5dc3-4499-9f48-d83bc5083c0d\", \"cluster_fsid\": \"1ffcdf7e-cdea-11ee-95ba-87774f69a715\", \"block_uuid\": \"41Y0X4-nWXz-cV6I-uujd-Xjr2-fty5-gy6PyH\"}, {\"name\": \"lv_5\", \"comment\": \"not used by ceph\"}], \"human_readable_type\": \"ssd\", \"device_id\": \"INTEL SSDPED1D480GA_PHMB751300EW480DGN\", \"lsm_data\": {}}, {\"ceph_device\": null, \"rejected_reasons\": [\"locked\"], \"available\": false, \"path\": \"/dev/sda\", \"sys_api\": {\"removable\": \"0\", \"ro\": \"0\", \"vendor\": \"ATA\", \"model\": \"ST1000NM0033-9ZM\", \"rev\": \"SN04\", \"sas_address\": \"\", \"sas_device_handle\": \"\", \"support_discard\": \"0\", \"rotational\": \"1\", \"nr_requests\": \"64\", \"scheduler_mode\": \"mq-deadline\", \"partitions\": {\"sda1\": {\"start\": \"2048\", \"sectors\": \"1953522688\", \"sectorsize\": 512, \"size\": 1000203616256.0, \"human_readable_size\": \"931.51 GB\", \"holders\": []}}, \"sectors\": 0, \"sectorsize\": \"512\", \"size\": 1000204886016.0, \"human_readable_size\": \"931.51 GB\", \"path\": \"/dev/sda\", \"locked\": 1}, \"created\": \"2024-02-17T23:24:27.634022Z\", \"lvs\": [], \"human_readable_type\": \"hdd\", \"device_id\": \"ST1000NM0033-9ZM_Z1W4HQ1L\", \"lsm_data\": {}}], \"osdspec_previews\": [], \"osdspec_last_applied\": {}, \"daemon_config_deps\": {\"mon.c\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:36.679309Z\"}, \"mgr.y\": {\"deps\": [], \"last_config\": \"2024-02-17T23:25:14.496812Z\"}, \"osd.0\": {\"deps\": [], \"last_config\": \"2024-02-17T23:15:59.405561Z\"}, \"osd.1\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:19.726335Z\"}, \"osd.2\": {\"deps\": [], \"last_config\": \"2024-02-17T23:16:39.640953Z\"}, \"osd.3\": {\"deps\": [], \"last_config\": \"2024-02-17T23:17:01.163890Z\"}, \"node-exporter.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:18:55.186827Z\"}, \"alertmanager.a\": {\"deps\": [\"alertmanager.a\", \"mgr.x\", \"mgr.y\"], \"last_config\": \"2024-02-17T23:24:48.858280Z\"}, \"rgw.r.z.smithi005.dlhvju\": {\"deps\": [], \"last_config\": \"2024-02-17T23:20:42.524420Z\"}, \"mon.a\": {\"deps\": [], \"last_config\": \"2024-02-17T23:26:11.217475Z\"}}, \"last_daemon_update\": \"2024-02-17T23:26:46.371663Z\", \"last_device_update\": \"2024-02-17T23:17:10.056653Z\", \"networks_and_interfaces\": {}, \"last_host_check\": \"2024-02-17T23:24:39.409790Z\", \"last_client_files\": {}, \"scheduled_daemon_actions\": {}}"}]: dispatch 2024-02-17T23:26:47.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:46.376811+0000 mon.a (mon.0) 36 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:47.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:46.380051+0000 mon.b (mon.2) 199 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key set","key":"mgr/cephadm/osd_remove_queue","val":"[]"}]: dispatch 2024-02-17T23:26:47.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:46.382637+0000 mon.a (mon.0) 37 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:47.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:46.387943+0000 mon.b (mon.2) 200 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:47.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:46.388993+0000 mon.b (mon.2) 201 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "mon_mds_skip_sanity", "value": "1", "who": "mon"}]: dispatch 2024-02-17T23:26:47.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:46.390626+0000 mon.b (mon.2) 202 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:26:47.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:46.391725+0000 mon.b (mon.2) 203 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-02-17T23:26:47.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:46.392439+0000 mon.b (mon.2) 204 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-02-17T23:26:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:47 smithi080 bash[35203]: cephadm 2024-02-17T23:26:46.392966+0000 mgr.y (mgr.44106) 17 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-02-17T23:26:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:47 smithi080 bash[35203]: cluster 2024-02-17T23:26:46.775913+0000 mgr.y (mgr.44106) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:47 smithi080 bash[35203]: audit 2024-02-17T23:26:47.866140+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.b"}]: dispatch 2024-02-17T23:26:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:47 smithi080 bash[35203]: audit 2024-02-17T23:26:47.870526+0000 mon.a (mon.0) 38 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:47 smithi080 bash[35203]: audit 2024-02-17T23:26:47.872309+0000 mon.b (mon.2) 206 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:26:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:47 smithi080 bash[35203]: audit 2024-02-17T23:26:47.873217+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:26:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:47 smithi080 bash[35203]: audit 2024-02-17T23:26:47.873921+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:26:48.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:47 smithi080 bash[35203]: audit 2024-02-17T23:26:47.875114+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-17T23:26:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:26:46.392966+0000 mgr.y (mgr.44106) 17 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-02-17T23:26:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:46.775913+0000 mgr.y (mgr.44106) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:47.866140+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.b"}]: dispatch 2024-02-17T23:26:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:47.870526+0000 mon.a (mon.0) 38 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:47.872309+0000 mon.b (mon.2) 206 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:26:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:47.873217+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:26:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:47.873921+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:26:48.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:47.875114+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-17T23:26:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:26:46.392966+0000 mgr.y (mgr.44106) 17 : cephadm [INF] Upgrade: It appears safe to stop mon.b 2024-02-17T23:26:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:46.775913+0000 mgr.y (mgr.44106) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:47.866140+0000 mon.b (mon.2) 205 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config set", "name": "container_image", "value": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", "who": "mon.b"}]: dispatch 2024-02-17T23:26:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:47.870526+0000 mon.a (mon.0) 38 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:26:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:47.872309+0000 mon.b (mon.2) 206 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:26:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:47.873217+0000 mon.b (mon.2) 207 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:26:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:47.873921+0000 mon.b (mon.2) 208 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:26:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:47.875114+0000 mon.b (mon.2) 209 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-17T23:26:49.307 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:48 smithi080 bash[35203]: cephadm 2024-02-17T23:26:47.865563+0000 mgr.y (mgr.44106) 19 : cephadm [INF] Upgrade: Updating mon.b 2024-02-17T23:26:49.307 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:48 smithi080 bash[35203]: cephadm 2024-02-17T23:26:47.874664+0000 mgr.y (mgr.44106) 20 : cephadm [INF] Deploying daemon mon.b on smithi080 2024-02-17T23:26:49.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:26:47.865563+0000 mgr.y (mgr.44106) 19 : cephadm [INF] Upgrade: Updating mon.b 2024-02-17T23:26:49.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:26:47.874664+0000 mgr.y (mgr.44106) 20 : cephadm [INF] Deploying daemon mon.b on smithi080 2024-02-17T23:26:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:26:47.865563+0000 mgr.y (mgr.44106) 19 : cephadm [INF] Upgrade: Updating mon.b 2024-02-17T23:26:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:26:47.874664+0000 mgr.y (mgr.44106) 20 : cephadm [INF] Deploying daemon mon.b on smithi080 2024-02-17T23:26:49.591 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:49 smithi080 systemd[1]: Stopping Ceph mon.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:26:49.591 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:49 smithi080 bash[35203]: debug 2024-02-17T23:26:49.588+0000 7fc6a37cd700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:26:49.591 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:49 smithi080 bash[35203]: debug 2024-02-17T23:26:49.588+0000 7fc6a37cd700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-02-17T23:26:50.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:50 smithi080 bash[54490]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon.b 2024-02-17T23:26:51.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:50 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.b.service: Succeeded. 2024-02-17T23:26:51.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:50 smithi080 systemd[1]: Stopped Ceph mon.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:26:51.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 systemd[1]: Starting Ceph mon.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.482+0000 7f4b3b160880 0 set uid:gid to 167:167 (ceph:ceph) 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.482+0000 7f4b3b160880 0 ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable), process ceph-mon, pid 7 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.482+0000 7f4b3b160880 0 pidfile_write: ignore empty --pid-file 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.486+0000 7f4b3b160880 0 load: jerasure load: lrc load: isa 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: RocksDB version: 6.8.1 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Compile date Feb 17 2024 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: DB SUMMARY 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: CURRENT file: CURRENT 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: IDENTITY file: IDENTITY 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 824 Bytes 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 3, files: 000022.sst 000023.sst 000025.sst 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000024.log size: 6097782 ; 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.error_if_exists: 0 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.create_if_missing: 0 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.paranoid_checks: 1 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.env: 0x56545de1d080 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.fs: Posix File System 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.info_log: 0x5654605a8260 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_file_opening_threads: 16 2024-02-17T23:26:51.892 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.statistics: (nil) 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.use_fsync: 0 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_log_file_size: 0 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.keep_log_file_num: 1000 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.recycle_log_file_num: 0 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.allow_fallocate: 1 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.allow_mmap_reads: 0 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.allow_mmap_writes: 0 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.use_direct_reads: 0 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.create_missing_column_families: 0 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.db_log_dir: 2024-02-17T23:26:51.893 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_subcompactions: 1 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_background_flushes: -1 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.advise_random_on_open: 1 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.db_write_buffer_size: 0 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.write_buffer_manager: 0x56546129a360 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-02-17T23:26:51.894 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.rate_limiter: (nil) 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.wal_recovery_mode: 2 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.enable_thread_tracking: 0 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.enable_pipelined_write: 0 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.unordered_write: 0 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.row_cache: None 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.wal_filter: None 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.allow_ingest_behind: 0 2024-02-17T23:26:51.895 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.preserve_deletes: 0 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.two_write_queues: 0 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.manual_wal_flush: 0 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.atomic_flush: 0 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.log_readahead_size: 0 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_background_jobs: 2 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_background_compactions: -1 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_total_wal_size: 0 2024-02-17T23:26:51.896 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_open_files: -1 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.bytes_per_sync: 0 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_readahead_size: 0 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Compression algorithms supported: 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: kZSTD supported: 0 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: kXpressCompression supported: 0 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: kLZ4HCCompression supported: 1 2024-02-17T23:26:51.897 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: kLZ4Compression supported: 1 2024-02-17T23:26:51.898 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: kBZip2Compression supported: 0 2024-02-17T23:26:51.898 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: kZlibCompression supported: 1 2024-02-17T23:26:51.898 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: kSnappyCompression supported: 1 2024-02-17T23:26:51.898 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-02-17T23:26:51.898 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-02-17T23:26:51.898 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.898 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-02-17T23:26:51.898 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.898 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-02-17T23:26:51.898 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.merge_operator: 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_filter: None 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_filter_factory: None 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56546054dd10) 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cache_index_and_filter_blocks: 1 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cache_index_and_filter_blocks_with_high_priority: 0 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: pin_top_level_index_and_filter: 1 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: index_type: 0 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: data_block_index_type: 0 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: index_shortening: 1 2024-02-17T23:26:51.900 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: data_block_hash_table_util_ratio: 0.750000 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: hash_index_allow_collision: 1 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: checksum: 1 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: no_block_cache: 0 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: block_cache: 0x565460582f10 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: block_cache_name: BinnedLRUCache 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: block_cache_options: 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: capacity : 536870912 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: num_shard_bits : 4 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: strict_capacity_limit : 0 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: high_pri_pool_ratio: 0.000 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: block_cache_compressed: (nil) 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: persistent_cache: (nil) 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: block_size: 4096 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: block_size_deviation: 10 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: block_restart_interval: 16 2024-02-17T23:26:51.901 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: index_block_restart_interval: 1 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: metadata_block_size: 4096 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: partition_filters: 0 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: use_delta_encoding: 1 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: filter_policy: rocksdb.BuiltinBloomFilter 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: whole_key_filtering: 1 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: verify_compression: 0 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: read_amp_bytes_per_bit: 0 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: format_version: 2 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: enable_index_compression: 1 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: block_align: 0 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.write_buffer_size: 33554432 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_write_buffer_number: 2 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compression: NoCompression 2024-02-17T23:26:51.902 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.bottommost_compression: Disabled 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.prefix_extractor: nullptr 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.num_levels: 7 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-02-17T23:26:51.903 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compression_opts.level: 32767 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compression_opts.strategy: 0 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compression_opts.enabled: false 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.target_file_size_base: 67108864 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-02-17T23:26:51.904 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.arena_block_size: 4194304 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.disable_auto_compactions: 0 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-02-17T23:26:51.905 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.table_properties_collectors: 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.inplace_update_support: 0 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.bloom_locality: 0 2024-02-17T23:26:51.906 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.max_successive_merges: 0 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.paranoid_file_checks: 0 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.force_consistency_checks: 0 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.report_bg_io_stats: 0 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.ttl: 2592000 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.487+0000 7f4b3b160880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.488+0000 7f4b3b160880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 27, last_sequence is 10799, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.488+0000 7f4b3b160880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 24 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.488+0000 7f4b3b160880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708212411489004, "job": 1, "event": "recovery_started", "log_files": [24]} 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.488+0000 7f4b3b160880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #24 mode 2 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.493+0000 7f4b3b160880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.499+0000 7f4b3b160880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708212411500224, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 4020829, "table_properties": {"data_size": 4016579, "index_size": 2979, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 453, "raw_key_size": 3209, "raw_average_key_size": 20, "raw_value_size": 4011947, "raw_average_value_size": 26221, "num_data_blocks": 95, "num_entries": 153, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1708212411, "oldest_key_time": 3, "file_creation_time": 0}} 2024-02-17T23:26:51.907 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.499+0000 7f4b3b160880 4 rocksdb: [version_set.cc:3826] Creating manifest 28 2024-02-17T23:26:51.908 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.908 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.499+0000 7f4b3b160880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1708212411500705, "job": 1, "event": "recovery_finished"} 2024-02-17T23:26:51.908 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.501+0000 7f4b3b160880 4 rocksdb: DB pointer 0x56546064b800 2024-02-17T23:26:51.908 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.501+0000 7f4b21f52700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-02-17T23:26:51.908 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.501+0000 7f4b21f52700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-02-17T23:26:51.908 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ** DB Stats ** 2024-02-17T23:26:51.908 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:26:51.908 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-02-17T23:26:51.908 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-02-17T23:26:51.908 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ** Compaction Stats [default] ** 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: L0 2/0 24.06 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.5 0.01 0.00 1 0.006 0 0 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: L6 2/0 65.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Sum 4/0 89.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.5 0.01 0.00 1 0.006 0 0 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.5 0.01 0.00 1 0.006 0 0 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ** Compaction Stats [default] ** 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:51.909 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 597.5 0.01 0.00 1 0.006 0 0 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Flush(GB): cumulative 0.004, interval 0.004 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Cumulative compaction: 0.00 GB write, 279.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Interval compaction: 0.00 GB write, 279.71 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ** Compaction Stats [default] ** 2024-02-17T23:26:51.910 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: L0 2/0 24.06 MB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.5 0.01 0.00 1 0.006 0 0 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: L6 2/0 65.06 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Sum 4/0 89.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 597.5 0.01 0.00 1 0.006 0 0 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ** Compaction Stats [default] ** 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 597.5 0.01 0.00 1 0.006 0 0 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Uptime(secs): 0.0 total, 0.0 interval 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Flush(GB): cumulative 0.004, interval 0.000 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: AddFile(GB): cumulative 0.000, interval 0.000 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: AddFile(Total Files): cumulative 0, interval 0 2024-02-17T23:26:51.911 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: AddFile(L0 Files): cumulative 0, interval 0 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: AddFile(Keys): cumulative 0, interval 0 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Cumulative compaction: 0.00 GB write, 279.02 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: ** File Read Latency Histogram By Level [default] ** 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.501+0000 7f4b3b160880 0 starting mon.b rank 2 at public addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] at bind addrs [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.502+0000 7f4b3b160880 1 mon.b@-1(???) e3 preinit fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.502+0000 7f4b3b160880 0 mon.b@-1(???).mds e1 new map 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.502+0000 7f4b3b160880 0 mon.b@-1(???).mds e1 print_map 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: e1 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: enable_multiple, ever_enabled_multiple: 0,0 2024-02-17T23:26:51.912 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: legacy client fscid: -1 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: No filesystems configured 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.502+0000 7f4b3b160880 0 mon.b@-1(???).osd e66 crush map has features 3314933000852226048, adjusting msgr requires 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.502+0000 7f4b3b160880 0 mon.b@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.502+0000 7f4b3b160880 0 mon.b@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.502+0000 7f4b3b160880 0 mon.b@-1(???).osd e66 crush map has features 288514051259236352, adjusting msgr requires 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:26:47.865563+0000 mgr.y (mgr.44106) 19 : cephadm [INF] Upgrade: Updating mon.b 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:26:47.874664+0000 mgr.y (mgr.44106) 20 : cephadm [INF] Deploying daemon mon.b on smithi080 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:26:51.503+0000 7f4b3b160880 1 mon.b@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 bash[54677]: 337c3ebc36ca1cbbc292f3de1899724fe5be8754016c086d25aed1acdea67a1b 2024-02-17T23:26:51.913 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:51 smithi080 systemd[1]: Started Ceph mon.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:26:53.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:48.776474+0000 mgr.y (mgr.44106) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:53.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:49.601492+0000 mon.c (mon.1) 2 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:26:53.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:49.601783+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:26:53.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:49.602071+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:26:53.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:48.776474+0000 mgr.y (mgr.44106) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:53.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:49.601492+0000 mon.c (mon.1) 2 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:26:53.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:49.601783+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:26:53.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:49.602071+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:26:53.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:26:48.776474+0000 mgr.y (mgr.44106) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:53.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:26:49.601492+0000 mon.c (mon.1) 2 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:26:53.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:26:49.601783+0000 mon.c (mon.1) 3 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:26:53.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:26:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:26:49.602071+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:26:56.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:26:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:26:56.508+0000 7f36ce75d700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-02-17T23:26:58.047 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:52.777695+0000 mgr.y (mgr.44106) 23 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:58.047 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:52.777695+0000 mgr.y (mgr.44106) 23 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:52.971391+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:52.971648+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:52.971852+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:52.972253+0000 mon.a (mon.0) 46 : cluster [INF] mon.a calling monitor election 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:52.972308+0000 mon.c (mon.1) 8 : cluster [INF] mon.c calling monitor election 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:54.778575+0000 mgr.y (mgr.44106) 24 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:56.779195+0000 mgr.y (mgr.44106) 25 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:57.973573+0000 mon.a (mon.0) 47 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:57.977282+0000 mon.a (mon.0) 48 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:57.990476+0000 mon.a (mon.0) 49 : cluster [DBG] fsmap 2024-02-17T23:26:58.048 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:57.990521+0000 mon.a (mon.0) 50 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:26:58.049 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:57.990969+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e31: y(active, since 35s), standbys: x 2024-02-17T23:26:58.049 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:57.991165+0000 mon.a (mon.0) 52 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-17T23:26:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:57.996206+0000 mon.a (mon.0) 53 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-02-17T23:26:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:57.996234+0000 mon.a (mon.0) 54 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-17T23:26:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:57.996254+0000 mon.a (mon.0) 55 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] is down (out of quorum) 2024-02-17T23:26:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:58.000337+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.44106 ' entity='' 2024-02-17T23:26:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:58.001935+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:26:58.003764+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:26:58.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:52.971391+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-02-17T23:26:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:52.971648+0000 mon.c (mon.1) 6 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-02-17T23:26:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:52.971852+0000 mon.c (mon.1) 7 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-02-17T23:26:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:52.972253+0000 mon.a (mon.0) 46 : cluster [INF] mon.a calling monitor election 2024-02-17T23:26:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:52.972308+0000 mon.c (mon.1) 8 : cluster [INF] mon.c calling monitor election 2024-02-17T23:26:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:54.778575+0000 mgr.y (mgr.44106) 24 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:56.779195+0000 mgr.y (mgr.44106) 25 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:26:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:57.973573+0000 mon.a (mon.0) 47 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-02-17T23:26:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:57.977282+0000 mon.a (mon.0) 48 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:26:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:57.990476+0000 mon.a (mon.0) 49 : cluster [DBG] fsmap 2024-02-17T23:26:58.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:57.990521+0000 mon.a (mon.0) 50 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:26:58.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:57.990969+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e31: y(active, since 35s), standbys: x 2024-02-17T23:26:58.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:57.991165+0000 mon.a (mon.0) 52 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2024-02-17T23:26:58.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:57.996206+0000 mon.a (mon.0) 53 : cluster [WRN] Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2024-02-17T23:26:58.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:57.996234+0000 mon.a (mon.0) 54 : cluster [WRN] [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2024-02-17T23:26:58.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:57.996254+0000 mon.a (mon.0) 55 : cluster [WRN] mon.b (rank 2) addr [v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0] is down (out of quorum) 2024-02-17T23:26:58.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:58.000337+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.44106 ' entity='' 2024-02-17T23:26:58.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:58.001935+0000 mon.c (mon.1) 9 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:26:58.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:26:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:26:58.003764+0000 mon.c (mon.1) 10 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:27:00.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:58.779569+0000 mgr.y (mgr.44106) 26 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:00.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:58.779569+0000 mgr.y (mgr.44106) 26 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:00.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:26:58.779569+0000 mgr.y (mgr.44106) 26 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:26:52.978192+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-17T23:27:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.528353+0000 mon.c (mon.1) 11 : cluster [INF] mon.c calling monitor election 2024-02-17T23:27:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.528355+0000 mon.a (mon.0) 57 : cluster [INF] mon.a calling monitor election 2024-02-17T23:27:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.554840+0000 mon.a (mon.0) 58 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:27:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.558345+0000 mon.a (mon.0) 59 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:27:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.558806+0000 mon.a (mon.0) 60 : cluster [DBG] fsmap 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.558839+0000 mon.a (mon.0) 61 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.559243+0000 mon.a (mon.0) 62 : cluster [DBG] mgrmap e31: y(active, since 37s), standbys: x 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.559418+0000 mon.a (mon.0) 63 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.559445+0000 mon.a (mon.0) 64 : cluster [INF] Cluster is now healthy 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.575869+0000 mon.a (mon.0) 65 : cluster [INF] overall HEALTH_OK 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:26:52.978192+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.528353+0000 mon.c (mon.1) 11 : cluster [INF] mon.c calling monitor election 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.528355+0000 mon.a (mon.0) 57 : cluster [INF] mon.a calling monitor election 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.554840+0000 mon.a (mon.0) 58 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.558345+0000 mon.a (mon.0) 59 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.558806+0000 mon.a (mon.0) 60 : cluster [DBG] fsmap 2024-02-17T23:27:01.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.558839+0000 mon.a (mon.0) 61 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:27:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.559243+0000 mon.a (mon.0) 62 : cluster [DBG] mgrmap e31: y(active, since 37s), standbys: x 2024-02-17T23:27:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.559418+0000 mon.a (mon.0) 63 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-17T23:27:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.559445+0000 mon.a (mon.0) 64 : cluster [INF] Cluster is now healthy 2024-02-17T23:27:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.575869+0000 mon.a (mon.0) 65 : cluster [INF] overall HEALTH_OK 2024-02-17T23:27:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:26:52.978192+0000 mon.b (mon.2) 2 : cluster [INF] mon.b calling monitor election 2024-02-17T23:27:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.528353+0000 mon.c (mon.1) 11 : cluster [INF] mon.c calling monitor election 2024-02-17T23:27:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.528355+0000 mon.a (mon.0) 57 : cluster [INF] mon.a calling monitor election 2024-02-17T23:27:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.554840+0000 mon.a (mon.0) 58 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-02-17T23:27:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.558345+0000 mon.a (mon.0) 59 : cluster [DBG] monmap e4: 3 mons at {a=[v2:172.21.15.5:3300/0,v1:172.21.15.5:6789/0],b=[v2:172.21.15.80:3300/0,v1:172.21.15.80:6789/0],c=[v2:172.21.15.5:3301/0,v1:172.21.15.5:6790/0]} removed_ranks: {} 2024-02-17T23:27:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.558806+0000 mon.a (mon.0) 60 : cluster [DBG] fsmap 2024-02-17T23:27:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.558839+0000 mon.a (mon.0) 61 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2024-02-17T23:27:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.559243+0000 mon.a (mon.0) 62 : cluster [DBG] mgrmap e31: y(active, since 37s), standbys: x 2024-02-17T23:27:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.559418+0000 mon.a (mon.0) 63 : cluster [INF] Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2024-02-17T23:27:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.559445+0000 mon.a (mon.0) 64 : cluster [INF] Cluster is now healthy 2024-02-17T23:27:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.575869+0000 mon.a (mon.0) 65 : cluster [INF] overall HEALTH_OK 2024-02-17T23:27:02.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:00.780369+0000 mgr.y (mgr.44106) 27 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:02.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:00.780369+0000 mgr.y (mgr.44106) 27 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:02.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:00.780369+0000 mgr.y (mgr.44106) 27 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:03.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:27:03 smithi005 bash[57630]: ts=2024-02-17T23:27:03.248Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephMgrPrometheusModuleInactive\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-17T23:27:04.091 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:02.780839+0000 mgr.y (mgr.44106) 28 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:04.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:03.382740+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:04.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:03.388101+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:04.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:03.391800+0000 mon.c (mon.1) 12 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:27:04.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:03.392595+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:27:04.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:03.393351+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:04.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:03.394433+0000 mon.c (mon.1) 15 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-17T23:27:04.092 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:02.780839+0000 mgr.y (mgr.44106) 28 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:04.092 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:03.382740+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:04.092 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:03.388101+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:04.092 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:03.391800+0000 mon.c (mon.1) 12 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:27:04.093 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:03.392595+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:27:04.093 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:03.393351+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:04.093 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:03.394433+0000 mon.c (mon.1) 15 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-17T23:27:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:02.780839+0000 mgr.y (mgr.44106) 28 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:03.382740+0000 mon.a (mon.0) 66 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:03.388101+0000 mon.a (mon.0) 67 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:03.391800+0000 mon.c (mon.1) 12 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:27:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:03.392595+0000 mon.c (mon.1) 13 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:27:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:03.393351+0000 mon.c (mon.1) 14 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:03.394433+0000 mon.c (mon.1) 15 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "container_image"}]: dispatch 2024-02-17T23:27:05.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:03.391531+0000 mgr.y (mgr.44106) 29 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-17T23:27:05.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:03.394001+0000 mgr.y (mgr.44106) 30 : cephadm [INF] Reconfiguring daemon mon.a on smithi005 2024-02-17T23:27:05.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:05.016305+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:05.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:05.017821+0000 mon.c (mon.1) 16 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:05.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:05.018184+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:05.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:05.019116+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:27:05.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:05.019878+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:05.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:05.020887+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-17T23:27:05.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:03.391531+0000 mgr.y (mgr.44106) 29 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-17T23:27:05.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:03.394001+0000 mgr.y (mgr.44106) 30 : cephadm [INF] Reconfiguring daemon mon.a on smithi005 2024-02-17T23:27:05.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:05.016305+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:05.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:05.017821+0000 mon.c (mon.1) 16 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:05.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:05.018184+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:05.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:05.019116+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:27:05.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:05.019878+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:05.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:05.020887+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-17T23:27:05.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:03.391531+0000 mgr.y (mgr.44106) 29 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2024-02-17T23:27:05.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:03.394001+0000 mgr.y (mgr.44106) 30 : cephadm [INF] Reconfiguring daemon mon.a on smithi005 2024-02-17T23:27:05.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:05.016305+0000 mon.a (mon.0) 68 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:05.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:05.017821+0000 mon.c (mon.1) 16 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:05.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:05.018184+0000 mon.a (mon.0) 69 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:05.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:05.019116+0000 mon.c (mon.1) 17 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:27:05.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:05.019878+0000 mon.c (mon.1) 18 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:05.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:05.020887+0000 mon.c (mon.1) 19 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.y","key": "container_image"}]: dispatch 2024-02-17T23:27:06.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:04.781542+0000 mgr.y (mgr.44106) 31 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:06.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:05.017521+0000 mgr.y (mgr.44106) 32 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-17T23:27:06.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:05.020529+0000 mgr.y (mgr.44106) 33 : cephadm [INF] Reconfiguring daemon mgr.y on smithi005 2024-02-17T23:27:06.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:04.781542+0000 mgr.y (mgr.44106) 31 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:06.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:05.017521+0000 mgr.y (mgr.44106) 32 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-17T23:27:06.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:05.020529+0000 mgr.y (mgr.44106) 33 : cephadm [INF] Reconfiguring daemon mgr.y on smithi005 2024-02-17T23:27:06.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:04.781542+0000 mgr.y (mgr.44106) 31 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:06.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:05.017521+0000 mgr.y (mgr.44106) 32 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2024-02-17T23:27:06.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:05.020529+0000 mgr.y (mgr.44106) 33 : cephadm [INF] Reconfiguring daemon mgr.y on smithi005 2024-02-17T23:27:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:06.674356+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:06.675545+0000 mgr.y (mgr.44106) 34 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-17T23:27:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:06.675815+0000 mon.c (mon.1) 20 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:27:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:06.676566+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:27:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:06.677291+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:06.677906+0000 mgr.y (mgr.44106) 35 : cephadm [INF] Reconfiguring daemon mon.c on smithi005 2024-02-17T23:27:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:06.678304+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-17T23:27:08.109 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:06.781933+0000 mgr.y (mgr.44106) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:08.109 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:06.674356+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:08.110 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:06.675545+0000 mgr.y (mgr.44106) 34 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-17T23:27:08.110 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:06.675815+0000 mon.c (mon.1) 20 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:27:08.110 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:06.676566+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:27:08.110 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:06.677291+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:08.110 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:06.677906+0000 mgr.y (mgr.44106) 35 : cephadm [INF] Reconfiguring daemon mon.c on smithi005 2024-02-17T23:27:08.110 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:06.678304+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-17T23:27:08.110 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:06.781933+0000 mgr.y (mgr.44106) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:06.674356+0000 mon.a (mon.0) 70 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:06.675545+0000 mgr.y (mgr.44106) 34 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2024-02-17T23:27:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:06.675815+0000 mon.c (mon.1) 20 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:27:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:06.676566+0000 mon.c (mon.1) 21 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:27:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:06.677291+0000 mon.c (mon.1) 22 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:06.677906+0000 mgr.y (mgr.44106) 35 : cephadm [INF] Reconfiguring daemon mon.c on smithi005 2024-02-17T23:27:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:06.678304+0000 mon.c (mon.1) 23 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "container_image"}]: dispatch 2024-02-17T23:27:08.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:06.781933+0000 mgr.y (mgr.44106) 36 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:09.199 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:27:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:08.160674+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:08.161950+0000 mgr.y (mgr.44106) 37 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-02-17T23:27:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:08.162213+0000 mon.c (mon.1) 24 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-17T23:27:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:08.162878+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:08.164071+0000 mgr.y (mgr.44106) 38 : cephadm [INF] Reconfiguring daemon osd.0 on smithi005 2024-02-17T23:27:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:08.164482+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-17T23:27:09.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:08.160674+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:09.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:08.161950+0000 mgr.y (mgr.44106) 37 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-02-17T23:27:09.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:08.162213+0000 mon.c (mon.1) 24 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-17T23:27:09.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:08.162878+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:09.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:08.164071+0000 mgr.y (mgr.44106) 38 : cephadm [INF] Reconfiguring daemon osd.0 on smithi005 2024-02-17T23:27:09.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:08.164482+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-17T23:27:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:08.160674+0000 mon.a (mon.0) 71 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:08.161950+0000 mgr.y (mgr.44106) 37 : cephadm [INF] Reconfiguring osd.0 (monmap changed)... 2024-02-17T23:27:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:08.162213+0000 mon.c (mon.1) 24 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-17T23:27:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:08.162878+0000 mon.c (mon.1) 25 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:08.164071+0000 mgr.y (mgr.44106) 38 : cephadm [INF] Reconfiguring daemon osd.0 on smithi005 2024-02-17T23:27:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:08.164482+0000 mon.c (mon.1) 26 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-17T23:27:09.868 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:27:09.868 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (2m) 23s ago 7m 16.1M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:27:09.868 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (7m) 6s ago 7m 34.4M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:27:09.868 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (66s) 6s ago 11m 383M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (101s) 23s ago 13m 412M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (54s) 23s ago 13m 41.1M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (18s) 6s ago 11m 26.5M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (29s) 23s ago 12m 20.8M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (8m) 23s ago 8m 12.5M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (8m) 6s ago 8m 13.7M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (11m) 23s ago 11m 46.6M 4096M 15.2.0 204a01f9b0b6 e7811399e7c1 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (10m) 23s ago 10m 43.0M 4096M 15.2.0 204a01f9b0b6 61f8f838512a 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (10m) 23s ago 10m 44.1M 4096M 15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (10m) 23s ago 10m 43.8M 4096M 15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (9m) 6s ago 9m 45.1M 4096M 15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (9m) 6s ago 9m 41.9M 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (9m) 6s ago 9m 41.5M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (8m) 6s ago 8m 45.1M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:27:09.869 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (119s) 6s ago 8m 37.8M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:27:09.870 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (6m) 23s ago 6m 37.3M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:27:09.870 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (6m) 6s ago 6m 39.0M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:27:10.288 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:27:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:27:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:27:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:27:10.288 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 10, 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 5 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:27:10.289 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:27:10.544 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:08.782424+0000 mgr.y (mgr.44106) 39 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:10.544 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.186327+0000 mgr.y (mgr.44106) 40 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:10.544 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.784790+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.786223+0000 mon.c (mon.1) 27 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.786840+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.788183+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.857179+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.857623+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.857955+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.858313+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.858643+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.858959+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.860639+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.860962+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.545 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:08.782424+0000 mgr.y (mgr.44106) 39 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.186327+0000 mgr.y (mgr.44106) 40 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.784790+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.786223+0000 mon.c (mon.1) 27 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.786840+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.788183+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.857179+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.857623+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.857955+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.858313+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.858643+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.858959+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.860639+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:10.546 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.860962+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.547 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.861303+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.547 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.861629+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.547 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.861945+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.547 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.861303+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.547 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.861629+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.547 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.861945+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.625 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:27:10.625 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:27:10.625 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:27:10.626 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:27:10.626 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:27:10.626 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:27:10.626 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-02-17T23:27:10.626 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:27:10.626 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "5/20 daemons upgraded", 2024-02-17T23:27:10.626 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading mon daemons", 2024-02-17T23:27:10.626 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:27:10.626 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:27:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:08.782424+0000 mgr.y (mgr.44106) 39 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.186327+0000 mgr.y (mgr.44106) 40 : audit [DBG] from='client.54103 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.784790+0000 mon.a (mon.0) 72 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.786223+0000 mon.c (mon.1) 27 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-17T23:27:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.786840+0000 mon.c (mon.1) 28 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.788183+0000 mon.c (mon.1) 29 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.857179+0000 mon.c (mon.1) 30 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.857623+0000 mon.c (mon.1) 31 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.857955+0000 mon.c (mon.1) 32 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.858313+0000 mon.c (mon.1) 33 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.858643+0000 mon.c (mon.1) 34 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.858959+0000 mon.c (mon.1) 35 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.860639+0000 mon.c (mon.1) 36 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.860962+0000 mon.c (mon.1) 37 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.861303+0000 mon.c (mon.1) 38 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.861629+0000 mon.c (mon.1) 39 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.861945+0000 mon.c (mon.1) 40 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:11.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.515612+0000 mgr.y (mgr.44106) 41 : audit [DBG] from='client.44154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:11.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:09.785961+0000 mgr.y (mgr.44106) 42 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-02-17T23:27:11.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:09.787847+0000 mgr.y (mgr.44106) 43 : cephadm [INF] Reconfiguring daemon osd.1 on smithi005 2024-02-17T23:27:11.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:09.854973+0000 mgr.y (mgr.44106) 44 : audit [DBG] from='client.44160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:11.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:10.286928+0000 mon.c (mon.1) 41 : audit [DBG] from='client.54121 172.21.15.5:0/1428564553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.515612+0000 mgr.y (mgr.44106) 41 : audit [DBG] from='client.44154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:09.785961+0000 mgr.y (mgr.44106) 42 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-02-17T23:27:11.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:09.787847+0000 mgr.y (mgr.44106) 43 : cephadm [INF] Reconfiguring daemon osd.1 on smithi005 2024-02-17T23:27:11.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:09.854973+0000 mgr.y (mgr.44106) 44 : audit [DBG] from='client.44160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:11.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:10.286928+0000 mon.c (mon.1) 41 : audit [DBG] from='client.54121 172.21.15.5:0/1428564553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.515612+0000 mgr.y (mgr.44106) 41 : audit [DBG] from='client.44154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:09.785961+0000 mgr.y (mgr.44106) 42 : cephadm [INF] Reconfiguring osd.1 (monmap changed)... 2024-02-17T23:27:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:09.787847+0000 mgr.y (mgr.44106) 43 : cephadm [INF] Reconfiguring daemon osd.1 on smithi005 2024-02-17T23:27:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:09.854973+0000 mgr.y (mgr.44106) 44 : audit [DBG] from='client.44160 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:10.286928+0000 mon.c (mon.1) 41 : audit [DBG] from='client.54121 172.21.15.5:0/1428564553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:12.439 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:10.624088+0000 mgr.y (mgr.44106) 45 : audit [DBG] from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:12.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:10.783015+0000 mgr.y (mgr.44106) 46 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:12.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:11.301919+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:12.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:11.303309+0000 mon.c (mon.1) 42 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-17T23:27:12.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:11.303920+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:12.440 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:11.305366+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-17T23:27:12.440 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:10.624088+0000 mgr.y (mgr.44106) 45 : audit [DBG] from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:12.440 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:10.783015+0000 mgr.y (mgr.44106) 46 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:12.440 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:11.301919+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:12.440 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:11.303309+0000 mon.c (mon.1) 42 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-17T23:27:12.441 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:11.303920+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:12.441 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:11.305366+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-17T23:27:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:10.624088+0000 mgr.y (mgr.44106) 45 : audit [DBG] from='client.54127 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:10.783015+0000 mgr.y (mgr.44106) 46 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:11.301919+0000 mon.a (mon.0) 73 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:11.303309+0000 mon.c (mon.1) 42 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-17T23:27:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:11.303920+0000 mon.c (mon.1) 43 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:11.305366+0000 mon.c (mon.1) 44 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-17T23:27:13.551 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:11.303070+0000 mgr.y (mgr.44106) 47 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-02-17T23:27:13.552 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:11.304993+0000 mgr.y (mgr.44106) 48 : cephadm [INF] Reconfiguring daemon osd.2 on smithi005 2024-02-17T23:27:13.552 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:12.852754+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:13.552 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:12.854210+0000 mon.c (mon.1) 45 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-17T23:27:13.552 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:12.854848+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:13.552 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:12.856255+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-17T23:27:13.552 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:11.303070+0000 mgr.y (mgr.44106) 47 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-02-17T23:27:13.552 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:11.304993+0000 mgr.y (mgr.44106) 48 : cephadm [INF] Reconfiguring daemon osd.2 on smithi005 2024-02-17T23:27:13.552 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:12.852754+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:13.552 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:12.854210+0000 mon.c (mon.1) 45 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-17T23:27:13.552 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:12.854848+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:13.553 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:12.856255+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-17T23:27:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:11.303070+0000 mgr.y (mgr.44106) 47 : cephadm [INF] Reconfiguring osd.2 (monmap changed)... 2024-02-17T23:27:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:11.304993+0000 mgr.y (mgr.44106) 48 : cephadm [INF] Reconfiguring daemon osd.2 on smithi005 2024-02-17T23:27:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:12.852754+0000 mon.a (mon.0) 74 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:12.854210+0000 mon.c (mon.1) 45 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-17T23:27:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:12.854848+0000 mon.c (mon.1) 46 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:12.856255+0000 mon.c (mon.1) 47 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-17T23:27:14.326 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:12.783365+0000 mgr.y (mgr.44106) 49 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:14.326 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:12.853971+0000 mgr.y (mgr.44106) 50 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-02-17T23:27:14.326 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:12.855904+0000 mgr.y (mgr.44106) 51 : cephadm [INF] Reconfiguring daemon osd.3 on smithi005 2024-02-17T23:27:14.326 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:12.783365+0000 mgr.y (mgr.44106) 49 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:14.327 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:12.853971+0000 mgr.y (mgr.44106) 50 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-02-17T23:27:14.327 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:12.855904+0000 mgr.y (mgr.44106) 51 : cephadm [INF] Reconfiguring daemon osd.3 on smithi005 2024-02-17T23:27:14.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:12.783365+0000 mgr.y (mgr.44106) 49 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:14.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:12.853971+0000 mgr.y (mgr.44106) 50 : cephadm [INF] Reconfiguring osd.3 (monmap changed)... 2024-02-17T23:27:14.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:12.855904+0000 mgr.y (mgr.44106) 51 : cephadm [INF] Reconfiguring daemon osd.3 on smithi005 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:14.389039+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:14.390479+0000 mgr.y (mgr.44106) 52 : cephadm [INF] Reconfiguring rgw.r.z.smithi005.dlhvju (monmap changed)... 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:14.390763+0000 mon.c (mon.1) 48 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:14.391102+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:14.391894+0000 mon.c (mon.1) 49 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:14.392191+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:14.395324+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:14.396006+0000 mgr.y (mgr.44106) 53 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi005.dlhvju 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:14.399784+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:14.400546+0000 mon.c (mon.1) 50 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi005.dlhvju"}]: dispatch 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:14.401129+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:15.753 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:14.401718+0000 mgr.y (mgr.44106) 54 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi005.dlhvju on smithi005 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:14.402059+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi005.dlhvju","key": "container_image"}]: dispatch 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:14.784154+0000 mgr.y (mgr.44106) 55 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:14.389039+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:14.390479+0000 mgr.y (mgr.44106) 52 : cephadm [INF] Reconfiguring rgw.r.z.smithi005.dlhvju (monmap changed)... 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:14.390763+0000 mon.c (mon.1) 48 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:14.391102+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:14.391894+0000 mon.c (mon.1) 49 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:14.392191+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:14.395324+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:14.396006+0000 mgr.y (mgr.44106) 53 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi005.dlhvju 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:14.399784+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:14.400546+0000 mon.c (mon.1) 50 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi005.dlhvju"}]: dispatch 2024-02-17T23:27:15.754 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:14.401129+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:15.755 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:14.401718+0000 mgr.y (mgr.44106) 54 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi005.dlhvju on smithi005 2024-02-17T23:27:15.755 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:14.402059+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi005.dlhvju","key": "container_image"}]: dispatch 2024-02-17T23:27:15.755 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:14.784154+0000 mgr.y (mgr.44106) 55 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:14.389039+0000 mon.a (mon.0) 75 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:14.390479+0000 mgr.y (mgr.44106) 52 : cephadm [INF] Reconfiguring rgw.r.z.smithi005.dlhvju (monmap changed)... 2024-02-17T23:27:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:14.390763+0000 mon.c (mon.1) 48 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:14.391102+0000 mon.a (mon.0) 76 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:14.391894+0000 mon.c (mon.1) 49 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:14.392191+0000 mon.a (mon.0) 77 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:14.395324+0000 mon.a (mon.0) 78 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-17T23:27:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:14.396006+0000 mgr.y (mgr.44106) 53 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi005.dlhvju 2024-02-17T23:27:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:14.399784+0000 mon.a (mon.0) 79 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:14.400546+0000 mon.c (mon.1) 50 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi005.dlhvju"}]: dispatch 2024-02-17T23:27:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:14.401129+0000 mon.c (mon.1) 51 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:14.401718+0000 mgr.y (mgr.44106) 54 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi005.dlhvju on smithi005 2024-02-17T23:27:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:14.402059+0000 mon.c (mon.1) 52 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi005.dlhvju","key": "container_image"}]: dispatch 2024-02-17T23:27:15.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:14.784154+0000 mgr.y (mgr.44106) 55 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:17.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:16.156800+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:17.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:16.157989+0000 mgr.y (mgr.44106) 56 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-17T23:27:17.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:16.158230+0000 mon.c (mon.1) 53 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:27:17.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:16.158899+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:27:17.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:16.159578+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:17.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:16.160163+0000 mgr.y (mgr.44106) 57 : cephadm [INF] Reconfiguring daemon mon.b on smithi080 2024-02-17T23:27:17.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:16.160528+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-17T23:27:17.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:16.156800+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:17.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:16.157989+0000 mgr.y (mgr.44106) 56 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-17T23:27:17.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:16.158230+0000 mon.c (mon.1) 53 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:27:17.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:16.158899+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:27:17.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:16.159578+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:17.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:16.160163+0000 mgr.y (mgr.44106) 57 : cephadm [INF] Reconfiguring daemon mon.b on smithi080 2024-02-17T23:27:17.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:16.160528+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-17T23:27:17.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:16.156800+0000 mon.a (mon.0) 80 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:17.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:16.157989+0000 mgr.y (mgr.44106) 56 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2024-02-17T23:27:17.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:16.158230+0000 mon.c (mon.1) 53 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-02-17T23:27:17.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:16.158899+0000 mon.c (mon.1) 54 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-02-17T23:27:17.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:16.159578+0000 mon.c (mon.1) 55 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:17.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:16.160163+0000 mgr.y (mgr.44106) 57 : cephadm [INF] Reconfiguring daemon mon.b on smithi080 2024-02-17T23:27:17.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:16.160528+0000 mon.c (mon.1) 56 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "container_image"}]: dispatch 2024-02-17T23:27:18.413 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:16.784582+0000 mgr.y (mgr.44106) 58 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:18.413 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:17.752086+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:18.413 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:17.753963+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:18.413 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:17.754344+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:18.413 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:17.755472+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:27:18.413 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:17.756289+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:18.414 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:17.757460+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-17T23:27:18.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:16.784582+0000 mgr.y (mgr.44106) 58 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:18.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:17.752086+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:18.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:17.753963+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:18.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:17.754344+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:18.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:17.755472+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:27:18.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:17.756289+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:18.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:17.757460+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-17T23:27:18.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:16.784582+0000 mgr.y (mgr.44106) 58 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:18.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:17.752086+0000 mon.a (mon.0) 81 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:18.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:17.753963+0000 mon.c (mon.1) 57 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:18.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:17.754344+0000 mon.a (mon.0) 82 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-02-17T23:27:18.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:17.755472+0000 mon.c (mon.1) 58 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-02-17T23:27:18.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:17.756289+0000 mon.c (mon.1) 59 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:18.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:17.757460+0000 mon.c (mon.1) 60 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mgr.x","key": "container_image"}]: dispatch 2024-02-17T23:27:19.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:17.753495+0000 mgr.y (mgr.44106) 59 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-02-17T23:27:19.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:17.756997+0000 mgr.y (mgr.44106) 60 : cephadm [INF] Reconfiguring daemon mgr.x on smithi080 2024-02-17T23:27:19.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:17.753495+0000 mgr.y (mgr.44106) 59 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-02-17T23:27:19.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:17.756997+0000 mgr.y (mgr.44106) 60 : cephadm [INF] Reconfiguring daemon mgr.x on smithi080 2024-02-17T23:27:19.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:17.753495+0000 mgr.y (mgr.44106) 59 : cephadm [INF] Reconfiguring mgr.x (monmap changed)... 2024-02-17T23:27:19.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:17.756997+0000 mgr.y (mgr.44106) 60 : cephadm [INF] Reconfiguring daemon mgr.x on smithi080 2024-02-17T23:27:20.426 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:18.785024+0000 mgr.y (mgr.44106) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:20.426 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:19.296755+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:20.426 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:19.298425+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-17T23:27:20.426 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:19.299264+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:20.426 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:19.301009+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-17T23:27:20.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:18.785024+0000 mgr.y (mgr.44106) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:20.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:19.296755+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:20.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:19.298425+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-17T23:27:20.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:19.299264+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:20.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:19.301009+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-17T23:27:20.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:18.785024+0000 mgr.y (mgr.44106) 61 : cluster [DBG] pgmap v28: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:20.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:19.296755+0000 mon.a (mon.0) 83 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:20.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:19.298425+0000 mon.c (mon.1) 61 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-17T23:27:20.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:19.299264+0000 mon.c (mon.1) 62 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:20.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:19.301009+0000 mon.c (mon.1) 63 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-17T23:27:21.545 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:19.298133+0000 mgr.y (mgr.44106) 62 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-02-17T23:27:21.545 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:19.300520+0000 mgr.y (mgr.44106) 63 : cephadm [INF] Reconfiguring daemon osd.4 on smithi080 2024-02-17T23:27:21.545 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:20.809292+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:21.545 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:20.810979+0000 mon.c (mon.1) 64 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:27:21.545 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:20.811833+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:21.545 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:20.813641+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-17T23:27:21.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:19.298133+0000 mgr.y (mgr.44106) 62 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-02-17T23:27:21.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:19.300520+0000 mgr.y (mgr.44106) 63 : cephadm [INF] Reconfiguring daemon osd.4 on smithi080 2024-02-17T23:27:21.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:20.809292+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:21.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:20.810979+0000 mon.c (mon.1) 64 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:27:21.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:20.811833+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:21.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:20.813641+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-17T23:27:21.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:19.298133+0000 mgr.y (mgr.44106) 62 : cephadm [INF] Reconfiguring osd.4 (monmap changed)... 2024-02-17T23:27:21.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:19.300520+0000 mgr.y (mgr.44106) 63 : cephadm [INF] Reconfiguring daemon osd.4 on smithi080 2024-02-17T23:27:21.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:20.809292+0000 mon.a (mon.0) 84 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:21.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:20.810979+0000 mon.c (mon.1) 64 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:27:21.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:20.811833+0000 mon.c (mon.1) 65 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:21.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:20.813641+0000 mon.c (mon.1) 66 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-17T23:27:22.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:20.785983+0000 mgr.y (mgr.44106) 64 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:22.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:20.810665+0000 mgr.y (mgr.44106) 65 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-02-17T23:27:22.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:20.813185+0000 mgr.y (mgr.44106) 66 : cephadm [INF] Reconfiguring daemon osd.5 on smithi080 2024-02-17T23:27:22.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:20.785983+0000 mgr.y (mgr.44106) 64 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:22.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:20.810665+0000 mgr.y (mgr.44106) 65 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-02-17T23:27:22.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:20.813185+0000 mgr.y (mgr.44106) 66 : cephadm [INF] Reconfiguring daemon osd.5 on smithi080 2024-02-17T23:27:22.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:20.785983+0000 mgr.y (mgr.44106) 64 : cluster [DBG] pgmap v29: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:22.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:20.810665+0000 mgr.y (mgr.44106) 65 : cephadm [INF] Reconfiguring osd.5 (monmap changed)... 2024-02-17T23:27:22.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:20.813185+0000 mgr.y (mgr.44106) 66 : cephadm [INF] Reconfiguring daemon osd.5 on smithi080 2024-02-17T23:27:23.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:22.508154+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:23.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:22.509514+0000 mgr.y (mgr.44106) 67 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-02-17T23:27:23.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:22.509834+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-17T23:27:23.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:22.510690+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:23.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:22.511981+0000 mgr.y (mgr.44106) 68 : cephadm [INF] Reconfiguring daemon osd.6 on smithi080 2024-02-17T23:27:23.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:22.512495+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-17T23:27:23.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:22.786403+0000 mgr.y (mgr.44106) 69 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:23.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:22.508154+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:23.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:22.509514+0000 mgr.y (mgr.44106) 67 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-02-17T23:27:23.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:22.509834+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-17T23:27:23.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:22.510690+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:23.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:22.511981+0000 mgr.y (mgr.44106) 68 : cephadm [INF] Reconfiguring daemon osd.6 on smithi080 2024-02-17T23:27:23.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:22.512495+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-17T23:27:23.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:22.786403+0000 mgr.y (mgr.44106) 69 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:23.878 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:22.508154+0000 mon.a (mon.0) 85 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:23.878 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:22.509514+0000 mgr.y (mgr.44106) 67 : cephadm [INF] Reconfiguring osd.6 (monmap changed)... 2024-02-17T23:27:23.878 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:22.509834+0000 mon.c (mon.1) 67 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-17T23:27:23.878 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:22.510690+0000 mon.c (mon.1) 68 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:23.878 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:22.511981+0000 mgr.y (mgr.44106) 68 : cephadm [INF] Reconfiguring daemon osd.6 on smithi080 2024-02-17T23:27:23.878 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:22.512495+0000 mon.c (mon.1) 69 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-17T23:27:23.878 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:22.786403+0000 mgr.y (mgr.44106) 69 : cluster [DBG] pgmap v30: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:25.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:23.944230+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:25.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:23.945575+0000 mgr.y (mgr.44106) 70 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-02-17T23:27:25.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:23.945899+0000 mon.c (mon.1) 70 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-17T23:27:25.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:23.946800+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:25.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:23.948120+0000 mgr.y (mgr.44106) 71 : cephadm [INF] Reconfiguring daemon osd.7 on smithi080 2024-02-17T23:27:25.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:23.948601+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-17T23:27:25.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:23.944230+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:25.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:23.945575+0000 mgr.y (mgr.44106) 70 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-02-17T23:27:25.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:23.945899+0000 mon.c (mon.1) 70 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-17T23:27:25.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:23.946800+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:25.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:23.948120+0000 mgr.y (mgr.44106) 71 : cephadm [INF] Reconfiguring daemon osd.7 on smithi080 2024-02-17T23:27:25.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:23.948601+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-17T23:27:25.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:23.944230+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:25.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:23.945575+0000 mgr.y (mgr.44106) 70 : cephadm [INF] Reconfiguring osd.7 (monmap changed)... 2024-02-17T23:27:25.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:23.945899+0000 mon.c (mon.1) 70 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-17T23:27:25.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:23.946800+0000 mon.c (mon.1) 71 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:25.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:23.948120+0000 mgr.y (mgr.44106) 71 : cephadm [INF] Reconfiguring daemon osd.7 on smithi080 2024-02-17T23:27:25.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:23.948601+0000 mon.c (mon.1) 72 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-17T23:27:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:24.787149+0000 mgr.y (mgr.44106) 72 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:25.474147+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:25.476329+0000 mon.c (mon.1) 73 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:25.476684+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:25.477830+0000 mon.c (mon.1) 74 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:25.478172+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:25.481641+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:25.486603+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:25.487559+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi080.qdwuig"}]: dispatch 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:25.488304+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:25.489488+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi080.qdwuig","key": "container_image"}]: dispatch 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:24.787149+0000 mgr.y (mgr.44106) 72 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:25.474147+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:25.476329+0000 mon.c (mon.1) 73 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:25.476684+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:25.477830+0000 mon.c (mon.1) 74 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:25.478172+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:25.481641+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-17T23:27:26.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:25.486603+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:26.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:25.487559+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi080.qdwuig"}]: dispatch 2024-02-17T23:27:26.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:25.488304+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:26.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:25.489488+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi080.qdwuig","key": "container_image"}]: dispatch 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:24.787149+0000 mgr.y (mgr.44106) 72 : cluster [DBG] pgmap v31: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:25.474147+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:25.476329+0000 mon.c (mon.1) 73 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:25.476684+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:25.477830+0000 mon.c (mon.1) 74 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:25.478172+0000 mon.a (mon.0) 89 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:25.481641+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "auth caps", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:25.486603+0000 mon.a (mon.0) 91 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:25.487559+0000 mon.c (mon.1) 75 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.rgw.r.z.smithi080.qdwuig"}]: dispatch 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:25.488304+0000 mon.c (mon.1) 76 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:25.489488+0000 mon.c (mon.1) 77 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi080.qdwuig","key": "container_image"}]: dispatch 2024-02-17T23:27:27.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:25.475979+0000 mgr.y (mgr.44106) 73 : cephadm [INF] Reconfiguring rgw.r.z.smithi080.qdwuig (monmap changed)... 2024-02-17T23:27:27.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:25.482466+0000 mgr.y (mgr.44106) 74 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi080.qdwuig 2024-02-17T23:27:27.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:25.488984+0000 mgr.y (mgr.44106) 75 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi080.qdwuig on smithi080 2024-02-17T23:27:27.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:25.475979+0000 mgr.y (mgr.44106) 73 : cephadm [INF] Reconfiguring rgw.r.z.smithi080.qdwuig (monmap changed)... 2024-02-17T23:27:27.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:25.482466+0000 mgr.y (mgr.44106) 74 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi080.qdwuig 2024-02-17T23:27:27.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:25.488984+0000 mgr.y (mgr.44106) 75 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi080.qdwuig on smithi080 2024-02-17T23:27:27.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:25.475979+0000 mgr.y (mgr.44106) 73 : cephadm [INF] Reconfiguring rgw.r.z.smithi080.qdwuig (monmap changed)... 2024-02-17T23:27:27.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:25.482466+0000 mgr.y (mgr.44106) 74 : cephadm [WRN] Unable to update caps for client.rgw.r.z.smithi080.qdwuig 2024-02-17T23:27:27.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:25.488984+0000 mgr.y (mgr.44106) 75 : cephadm [INF] Reconfiguring daemon rgw.r.z.smithi080.qdwuig on smithi080 2024-02-17T23:27:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:26.787524+0000 mgr.y (mgr.44106) 76 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.023424+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.025806+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:27:28.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.029265+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.031045+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:27.031912+0000 mgr.y (mgr.44106) 77 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.036832+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.037855+0000 mon.c (mon.1) 81 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.038256+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.042048+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.042964+0000 mon.c (mon.1) 82 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.043274+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.046668+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.047595+0000 mon.c (mon.1) 83 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.047924+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-17T23:27:28.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.051242+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:26.787524+0000 mgr.y (mgr.44106) 76 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.023424+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.025806+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.029265+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.031045+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:27.031912+0000 mgr.y (mgr.44106) 77 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.036832+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.037855+0000 mon.c (mon.1) 81 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.038256+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.042048+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.042964+0000 mon.c (mon.1) 82 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.043274+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-17T23:27:28.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.046668+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-02-17T23:27:28.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.047595+0000 mon.c (mon.1) 83 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-17T23:27:28.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.047924+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-17T23:27:28.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.051242+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-02-17T23:27:28.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.052551+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:28.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:27.053283+0000 mgr.y (mgr.44106) 78 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-17T23:27:28.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.057314+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:28.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.058851+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-17T23:27:28.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:27.059016+0000 mgr.y (mgr.44106) 79 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-17T23:27:28.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:27.059981+0000 mgr.y (mgr.44106) 80 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-17T23:27:28.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.052551+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:28.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:27.053283+0000 mgr.y (mgr.44106) 78 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-17T23:27:28.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.057314+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:28.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.058851+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-17T23:27:28.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:27.059016+0000 mgr.y (mgr.44106) 79 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-17T23:27:28.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:27.059981+0000 mgr.y (mgr.44106) 80 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-17T23:27:28.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:26.787524+0000 mgr.y (mgr.44106) 76 : cluster [DBG] pgmap v32: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:28.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.023424+0000 mon.a (mon.0) 92 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:28.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.025806+0000 mon.c (mon.1) 78 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:27:28.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.029265+0000 mon.c (mon.1) 79 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.031045+0000 mon.c (mon.1) 80 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:27.031912+0000 mgr.y (mgr.44106) 77 : cephadm [INF] Upgrade: Setting container_image for all mon 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.036832+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.037855+0000 mon.c (mon.1) 81 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.038256+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.042048+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.042964+0000 mon.c (mon.1) 82 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.043274+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.046668+0000 mon.a (mon.0) 97 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.047595+0000 mon.c (mon.1) 83 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.047924+0000 mon.a (mon.0) 98 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-02-17T23:27:28.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.051242+0000 mon.a (mon.0) 99 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-02-17T23:27:28.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.052551+0000 mon.c (mon.1) 84 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:28.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:27.053283+0000 mgr.y (mgr.44106) 78 : cephadm [INF] Upgrade: Setting container_image for all crash 2024-02-17T23:27:28.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.057314+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:28.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.058851+0000 mon.c (mon.1) 85 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-17T23:27:28.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:27.059016+0000 mgr.y (mgr.44106) 79 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-02-17T23:27:28.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:27.059981+0000 mgr.y (mgr.44106) 80 : cephadm [INF] Upgrade: osd.0 is safe to restart 2024-02-17T23:27:29.818 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:28.576193+0000 mgr.y (mgr.44106) 81 : cephadm [INF] Upgrade: Updating osd.0 2024-02-17T23:27:29.818 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.582389+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:29.818 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.583355+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-17T23:27:29.818 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.584023+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:29.818 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:28.585223+0000 mgr.y (mgr.44106) 82 : cephadm [INF] Deploying daemon osd.0 on smithi005 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.585637+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:28.787841+0000 mgr.y (mgr.44106) 83 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.813372+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.813590+0000 mon.c (mon.1) 90 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.813748+0000 mon.c (mon.1) 91 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.813777+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.813915+0000 mon.c (mon.1) 92 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.814450+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.814761+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:28.815069+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.819 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:28.576193+0000 mgr.y (mgr.44106) 81 : cephadm [INF] Upgrade: Updating osd.0 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.582389+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.583355+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.584023+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:28.585223+0000 mgr.y (mgr.44106) 82 : cephadm [INF] Deploying daemon osd.0 on smithi005 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.585637+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:28.787841+0000 mgr.y (mgr.44106) 83 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.813372+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.813590+0000 mon.c (mon.1) 90 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.813748+0000 mon.c (mon.1) 91 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.813777+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.813915+0000 mon.c (mon.1) 92 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.814450+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:27:29.820 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.814761+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.821 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:28.815069+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:28.576193+0000 mgr.y (mgr.44106) 81 : cephadm [INF] Upgrade: Updating osd.0 2024-02-17T23:27:29.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.582389+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:29.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.583355+0000 mon.c (mon.1) 86 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-02-17T23:27:29.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.584023+0000 mon.c (mon.1) 87 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:29.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:28.585223+0000 mgr.y (mgr.44106) 82 : cephadm [INF] Deploying daemon osd.0 on smithi005 2024-02-17T23:27:29.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.585637+0000 mon.c (mon.1) 88 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "container_image"}]: dispatch 2024-02-17T23:27:29.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:28.787841+0000 mgr.y (mgr.44106) 83 : cluster [DBG] pgmap v33: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:29.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.813372+0000 mon.c (mon.1) 89 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-17T23:27:29.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.813590+0000 mon.c (mon.1) 90 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:27:29.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.813748+0000 mon.c (mon.1) 91 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.813777+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1f", "id": [7, 2]}]: dispatch 2024-02-17T23:27:29.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.813915+0000 mon.c (mon.1) 92 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.814450+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:27:29.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.814761+0000 mon.a (mon.0) 104 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:27:29.891 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:28.815069+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:27:31.844 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:31 smithi005 systemd[1]: Stopping Ceph osd.0 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:27:32.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:30.788441+0000 mgr.y (mgr.44106) 84 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:32.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:30.788441+0000 mgr.y (mgr.44106) 84 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:32.127 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:31 smithi005 bash[40824]: debug 2024-02-17T23:27:31.885+0000 7f323a674700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:27:32.127 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:31 smithi005 bash[40824]: debug 2024-02-17T23:27:31.885+0000 7f323a674700 -1 osd.0 66 *** Got signal Terminated *** 2024-02-17T23:27:32.127 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:31 smithi005 bash[40824]: debug 2024-02-17T23:27:31.885+0000 7f323a674700 -1 osd.0 66 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:27:32.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:30.788441+0000 mgr.y (mgr.44106) 84 : cluster [DBG] pgmap v34: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:32.626 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:32 smithi005 bash[63827]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.0 2024-02-17T23:27:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:31.924401+0000 mon.a (mon.0) 106 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:31.924438+0000 mon.a (mon.0) 107 : cluster [INF] osd.0 failed (root=default,host=smithi005) (connection refused reported by osd.5) 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:31.924616+0000 mon.a (mon.0) 108 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.125391+0000 mon.a (mon.0) 109 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.125492+0000 mon.a (mon.0) 110 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.125579+0000 mon.a (mon.0) 111 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.125741+0000 mon.a (mon.0) 112 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.125827+0000 mon.a (mon.0) 113 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.125917+0000 mon.a (mon.0) 114 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.125990+0000 mon.a (mon.0) 115 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.126060+0000 mon.a (mon.0) 116 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.126150+0000 mon.a (mon.0) 117 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.126227+0000 mon.a (mon.0) 118 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.126308+0000 mon.a (mon.0) 119 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.126376+0000 mon.a (mon.0) 120 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.126456+0000 mon.a (mon.0) 121 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.126529+0000 mon.a (mon.0) 122 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.526169+0000 mon.a (mon.0) 123 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.526341+0000 mon.a (mon.0) 124 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.526490+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:31.924401+0000 mon.a (mon.0) 106 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:31.924438+0000 mon.a (mon.0) 107 : cluster [INF] osd.0 failed (root=default,host=smithi005) (connection refused reported by osd.5) 2024-02-17T23:27:33.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:31.924616+0000 mon.a (mon.0) 108 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.125391+0000 mon.a (mon.0) 109 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.125492+0000 mon.a (mon.0) 110 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.125579+0000 mon.a (mon.0) 111 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.125741+0000 mon.a (mon.0) 112 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.125827+0000 mon.a (mon.0) 113 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.125917+0000 mon.a (mon.0) 114 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.125990+0000 mon.a (mon.0) 115 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.126060+0000 mon.a (mon.0) 116 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.126150+0000 mon.a (mon.0) 117 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.126227+0000 mon.a (mon.0) 118 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.126308+0000 mon.a (mon.0) 119 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.126376+0000 mon.a (mon.0) 120 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.126456+0000 mon.a (mon.0) 121 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.126529+0000 mon.a (mon.0) 122 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.526169+0000 mon.a (mon.0) 123 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.526341+0000 mon.a (mon.0) 124 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.526490+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.526629+0000 mon.a (mon.0) 126 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.526774+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.526912+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.527056+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.527214+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.527353+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.527489+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.527631+0000 mon.a (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.527775+0000 mon.a (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.527917+0000 mon.a (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.528058+0000 mon.a (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.526629+0000 mon.a (mon.0) 126 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.526774+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.526912+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.527056+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.527214+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.527353+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.527489+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.527631+0000 mon.a (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.527775+0000 mon.a (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.527917+0000 mon.a (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.528058+0000 mon.a (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:31.924401+0000 mon.a (mon.0) 106 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:31.924438+0000 mon.a (mon.0) 107 : cluster [INF] osd.0 failed (root=default,host=smithi005) (connection refused reported by osd.5) 2024-02-17T23:27:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:31.924616+0000 mon.a (mon.0) 108 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.125391+0000 mon.a (mon.0) 109 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.125492+0000 mon.a (mon.0) 110 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.125579+0000 mon.a (mon.0) 111 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.125741+0000 mon.a (mon.0) 112 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.125827+0000 mon.a (mon.0) 113 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.125917+0000 mon.a (mon.0) 114 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.125990+0000 mon.a (mon.0) 115 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.126060+0000 mon.a (mon.0) 116 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.126150+0000 mon.a (mon.0) 117 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.126227+0000 mon.a (mon.0) 118 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.126308+0000 mon.a (mon.0) 119 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.126376+0000 mon.a (mon.0) 120 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.126456+0000 mon.a (mon.0) 121 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.126529+0000 mon.a (mon.0) 122 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.526169+0000 mon.a (mon.0) 123 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.526341+0000 mon.a (mon.0) 124 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.526490+0000 mon.a (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.526629+0000 mon.a (mon.0) 126 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.526774+0000 mon.a (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.526912+0000 mon.a (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.527056+0000 mon.a (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.527214+0000 mon.a (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.3 2024-02-17T23:27:33.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.527353+0000 mon.a (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.2 2024-02-17T23:27:33.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.527489+0000 mon.a (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.1 2024-02-17T23:27:33.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.527631+0000 mon.a (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.7 2024-02-17T23:27:33.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.527775+0000 mon.a (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.5 2024-02-17T23:27:33.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.527917+0000 mon.a (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.4 2024-02-17T23:27:33.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.528058+0000 mon.a (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.6 2024-02-17T23:27:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.788821+0000 mgr.y (mgr.44106) 85 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.842604+0000 mon.a (mon.0) 137 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:27:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:32.851107+0000 mon.a (mon.0) 138 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2024-02-17T23:27:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:32.851386+0000 mon.c (mon.1) 93 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:27:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:32.852040+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:27:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:32.854486+0000 mon.c (mon.1) 94 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:27:34.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:32.857937+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:27:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.788821+0000 mgr.y (mgr.44106) 85 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.842604+0000 mon.a (mon.0) 137 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:27:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:32.851107+0000 mon.a (mon.0) 138 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2024-02-17T23:27:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:32.851386+0000 mon.c (mon.1) 93 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:27:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:32.852040+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:27:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:32.854486+0000 mon.c (mon.1) 94 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:27:34.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:32.857937+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:27:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.788821+0000 mgr.y (mgr.44106) 85 : cluster [DBG] pgmap v35: 129 pgs: 129 active+clean; 7.0 KiB data, 5.9 MiB used, 707 GiB / 715 GiB avail 2024-02-17T23:27:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.842604+0000 mon.a (mon.0) 137 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:27:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:32.851107+0000 mon.a (mon.0) 138 : cluster [DBG] osdmap e67: 8 total, 7 up, 8 in 2024-02-17T23:27:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:32.851386+0000 mon.c (mon.1) 93 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:27:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:32.852040+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-02-17T23:27:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:32.854486+0000 mon.c (mon.1) 94 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:27:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:32.857937+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-02-17T23:27:34.859 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:34 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.0.service: Succeeded. 2024-02-17T23:27:34.859 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:34 smithi005 systemd[1]: Stopped Ceph osd.0 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:27:34.859 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:34 smithi005 systemd[1]: Starting Ceph osd.0 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:27:35.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:33.854207+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-17T23:27:35.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:33.854375+0000 mon.a (mon.0) 142 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2024-02-17T23:27:35.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:33.854207+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-17T23:27:35.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:33.854375+0000 mon.a (mon.0) 142 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2024-02-17T23:27:35.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:33.854207+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-02-17T23:27:35.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:33.854375+0000 mon.a (mon.0) 142 : cluster [DBG] osdmap e68: 8 total, 7 up, 8 in 2024-02-17T23:27:36.096 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:34.789505+0000 mgr.y (mgr.44106) 86 : cluster [DBG] pgmap v38: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:36.096 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:34.852096+0000 mon.a (mon.0) 143 : cluster [WRN] Health check failed: Degraded data redundancy: 67/606 objects degraded (11.056%), 22 pgs degraded (PG_DEGRADED) 2024-02-17T23:27:36.096 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:34.789505+0000 mgr.y (mgr.44106) 86 : cluster [DBG] pgmap v38: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:36.096 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:34.852096+0000 mon.a (mon.0) 143 : cluster [WRN] Health check failed: Degraded data redundancy: 67/606 objects degraded (11.056%), 22 pgs degraded (PG_DEGRADED) 2024-02-17T23:27:36.097 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:35 smithi005 bash[64129]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-17T23:27:36.097 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:35 smithi005 bash[64129]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-17T23:27:36.097 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:35 smithi005 bash[64129]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-02-17T23:27:36.097 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:35 smithi005 bash[64129]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-02-17T23:27:36.097 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:35 smithi005 bash[64129]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-02-17T23:27:36.097 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:35 smithi005 bash[64129]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-17T23:27:36.097 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:35 smithi005 bash[64129]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-02-17T23:27:36.097 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:35 smithi005 bash[64129]: --> ceph-volume lvm activate successful for osd ID: 0 2024-02-17T23:27:36.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:34.789505+0000 mgr.y (mgr.44106) 86 : cluster [DBG] pgmap v38: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:36.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:34.852096+0000 mon.a (mon.0) 143 : cluster [WRN] Health check failed: Degraded data redundancy: 67/606 objects degraded (11.056%), 22 pgs degraded (PG_DEGRADED) 2024-02-17T23:27:37.078 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-0[64418]: debug 2024-02-17T23:27:36.984+0000 7ff7701c3700 1 -- 172.21.15.5:0/3695496862 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55feefe0c680 con 0x55feefdd3800 2024-02-17T23:27:37.376 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:37 smithi005 bash[64403]: 601f1b6e410b1d469b4010eda8fec2b61b5f5eae1bdccd396ca45289b0ab2733 2024-02-17T23:27:37.376 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:37 smithi005 systemd[1]: Started Ceph osd.0 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:27:37.876 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-0[64418]: debug 2024-02-17T23:27:37.506+0000 7ff777c51380 -1 Falling back to public interface 2024-02-17T23:27:38.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:36.789906+0000 mgr.y (mgr.44106) 87 : cluster [DBG] pgmap v39: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:38.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:37.125866+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:38.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:37.127152+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:27:38.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:37.128439+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:27:38.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:36.789906+0000 mgr.y (mgr.44106) 87 : cluster [DBG] pgmap v39: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:38.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:37.125866+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:38.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:37.127152+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:27:38.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:37.128439+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:27:38.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:36.789906+0000 mgr.y (mgr.44106) 87 : cluster [DBG] pgmap v39: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:38.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:37.125866+0000 mon.a (mon.0) 144 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:38.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:37.127152+0000 mon.c (mon.1) 95 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:27:38.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:37.128439+0000 mon.c (mon.1) 96 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:27:40.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:38.790458+0000 mgr.y (mgr.44106) 88 : cluster [DBG] pgmap v40: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:40.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:38.790458+0000 mgr.y (mgr.44106) 88 : cluster [DBG] pgmap v40: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:40.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:38.790458+0000 mgr.y (mgr.44106) 88 : cluster [DBG] pgmap v40: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:40.627 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-0[64418]: debug 2024-02-17T23:27:40.231+0000 7ff777c51380 -1 osd.0 66 log_to_monitors {default=true} 2024-02-17T23:27:40.974 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:27:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:40.235242+0000 mon.c (mon.1) 97 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2227803114,v1:172.21.15.5:6803/2227803114]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:27:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:40.235542+0000 mon.a (mon.0) 145 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:27:41.416 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:40.235242+0000 mon.c (mon.1) 97 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2227803114,v1:172.21.15.5:6803/2227803114]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:27:41.416 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:40.235542+0000 mon.a (mon.0) 145 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:27:41.416 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:27:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-0[64418]: debug 2024-02-17T23:27:41.150+0000 7ff768937700 -1 osd.0 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T23:27:41.416 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:40.235242+0000 mon.c (mon.1) 97 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2227803114,v1:172.21.15.5:6803/2227803114]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:27:41.416 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:40.235542+0000 mon.a (mon.0) 145 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-02-17T23:27:41.688 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:27:41.688 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (2m) 0s ago 8m 16.1M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:27:41.688 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (8m) 38s ago 8m 34.4M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (98s) 38s ago 11m 383M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (2m) 0s ago 13m 420M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (86s) 0s ago 13m 46.7M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (50s) 38s ago 12m 26.5M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (61s) 0s ago 12m 41.1M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (8m) 0s ago 8m 12.3M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (8m) 38s ago 8m 13.7M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (5s) 0s ago 11m 13.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (11m) 0s ago 11m 44.2M 4096M 15.2.0 204a01f9b0b6 61f8f838512a 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (10m) 0s ago 11m 44.8M 4096M 15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (10m) 0s ago 10m 45.3M 4096M 15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (10m) 38s ago 10m 45.1M 4096M 15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (9m) 38s ago 10m 41.9M 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (9m) 38s ago 9m 41.5M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:27:41.689 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (9m) 38s ago 9m 45.1M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:27:41.690 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (2m) 38s ago 8m 37.8M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:27:41.690 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (6m) 0s ago 6m 37.7M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:27:41.690 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (6m) 38s ago 6m 39.0M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:27:42.104 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:27:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:27:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:27:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:27:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:27:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:27:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:27:42.104 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 9, 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 5 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:27:42.105 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:27:42.376 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:27:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:27:41.955+0000 7f36ce75d700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-17T23:27:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:40.791578+0000 mgr.y (mgr.44106) 89 : cluster [DBG] pgmap v41: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:40.961441+0000 mgr.y (mgr.44106) 90 : audit [DBG] from='client.54139 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.135531+0000 mon.a (mon.0) 146 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-17T23:27:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:41.135593+0000 mon.a (mon.0) 147 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2024-02-17T23:27:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.136926+0000 mon.c (mon.1) 98 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2227803114,v1:172.21.15.5:6803/2227803114]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:27:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.137334+0000 mon.a (mon.0) 148 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:27:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.624864+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.677649+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.678029+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.678350+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.678667+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.678991+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.679297+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.680910+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:42.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:40.791578+0000 mgr.y (mgr.44106) 89 : cluster [DBG] pgmap v41: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:42.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:40.961441+0000 mgr.y (mgr.44106) 90 : audit [DBG] from='client.54139 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:42.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.135531+0000 mon.a (mon.0) 146 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-17T23:27:42.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:41.135593+0000 mon.a (mon.0) 147 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2024-02-17T23:27:42.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.136926+0000 mon.c (mon.1) 98 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2227803114,v1:172.21.15.5:6803/2227803114]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:27:42.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.137334+0000 mon.a (mon.0) 148 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:27:42.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.624864+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:42.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.677649+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:42.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.678029+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.678350+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.678667+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.678991+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.679297+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.680910+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.681217+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.681518+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.681809+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.682116+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.945325+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.950175+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.952539+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.953728+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.954678+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.955875+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:42.099537+0000 mon.a (mon.0) 151 : audit [DBG] from='client.54157 172.21.15.5:0/3041396690' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.681217+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.681518+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.681809+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.682116+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.945325+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.950175+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.952539+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.953728+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.954678+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.955875+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:42.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:42.099537+0000 mon.a (mon.0) 151 : audit [DBG] from='client.54157 172.21.15.5:0/3041396690' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.440 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:27:42.441 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:27:42.441 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:27:42.441 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:27:42.441 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:27:42.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:27:42.441 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-02-17T23:27:42.441 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:27:42.442 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "6/20 daemons upgraded", 2024-02-17T23:27:42.442 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-02-17T23:27:42.442 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:27:42.442 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:27:42.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:42 smithi080 bash[37749]: debug 2024-02-17T23:27:42.142+0000 7ff7e87f1700 -1 osd.4 70 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:42.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:42 smithi080 bash[37749]: debug 2024-02-17T23:27:42.143+0000 7ff7e77ef700 -1 osd.4 70 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:42.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:42 smithi080 bash[37749]: debug 2024-02-17T23:27:42.144+0000 7ff7e6fee700 -1 osd.4 70 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:42.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:42 smithi080 bash[37749]: debug 2024-02-17T23:27:42.144+0000 7ff7e67ed700 -1 osd.4 70 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:42.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:42 smithi080 bash[37749]: debug 2024-02-17T23:27:42.151+0000 7ff7e3fe8700 -1 osd.4 70 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:42.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:40.791578+0000 mgr.y (mgr.44106) 89 : cluster [DBG] pgmap v41: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 6.0 MiB used, 707 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:42.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:40.961441+0000 mgr.y (mgr.44106) 90 : audit [DBG] from='client.54139 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:42.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.135531+0000 mon.a (mon.0) 146 : audit [INF] from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-02-17T23:27:42.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:41.135593+0000 mon.a (mon.0) 147 : cluster [DBG] osdmap e69: 8 total, 7 up, 8 in 2024-02-17T23:27:42.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.136926+0000 mon.c (mon.1) 98 : audit [INF] from='osd.0 [v2:172.21.15.5:6802/2227803114,v1:172.21.15.5:6803/2227803114]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:27:42.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.137334+0000 mon.a (mon.0) 148 : audit [INF] from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:27:42.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.624864+0000 mon.a (mon.0) 149 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:42.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.677649+0000 mon.c (mon.1) 99 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:42.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.678029+0000 mon.c (mon.1) 100 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:42.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.678350+0000 mon.c (mon.1) 101 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.678667+0000 mon.c (mon.1) 102 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.678991+0000 mon.c (mon.1) 103 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.679297+0000 mon.c (mon.1) 104 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.680910+0000 mon.c (mon.1) 105 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.681217+0000 mon.c (mon.1) 106 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.681518+0000 mon.c (mon.1) 107 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.681809+0000 mon.c (mon.1) 108 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.682116+0000 mon.c (mon.1) 109 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.945325+0000 mon.a (mon.0) 150 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.950175+0000 mon.c (mon.1) 110 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.952539+0000 mon.c (mon.1) 111 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.953728+0000 mon.c (mon.1) 112 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.954678+0000 mon.c (mon.1) 113 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.955875+0000 mon.c (mon.1) 114 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:42.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:42.099537+0000 mon.a (mon.0) 151 : audit [DBG] from='client.54157 172.21.15.5:0/3041396690' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:27:43.390 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:43 smithi080 bash[37749]: debug 2024-02-17T23:27:43.106+0000 7ff7e27e5700 -1 osd.4 70 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:43.390 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:43 smithi080 bash[37749]: debug 2024-02-17T23:27:43.106+0000 7ff7e2fe6700 -1 osd.4 70 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:43.390 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:43 smithi080 bash[37749]: debug 2024-02-17T23:27:43.106+0000 7ff7e4fea700 -1 osd.4 70 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:43.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.302150+0000 mgr.y (mgr.44106) 91 : audit [DBG] from='client.44190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:43.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.675765+0000 mgr.y (mgr.44106) 92 : audit [DBG] from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:41.956011+0000 mgr.y (mgr.44106) 93 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:41.956662+0000 mgr.y (mgr.44106) 94 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-17T23:27:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:42.133024+0000 mon.a (mon.0) 152 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:27:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:42.136851+0000 mon.a (mon.0) 153 : cluster [INF] osd.0 [v2:172.21.15.5:6802/2227803114,v1:172.21.15.5:6803/2227803114] boot 2024-02-17T23:27:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:42.136897+0000 mon.a (mon.0) 154 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-17T23:27:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:42.137335+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:27:43.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:43.139127+0000 mon.a (mon.0) 155 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-17T23:27:43.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.302150+0000 mgr.y (mgr.44106) 91 : audit [DBG] from='client.44190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:43.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.675765+0000 mgr.y (mgr.44106) 92 : audit [DBG] from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:43.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:41.956011+0000 mgr.y (mgr.44106) 93 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:43.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:41.956662+0000 mgr.y (mgr.44106) 94 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-17T23:27:43.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:42.133024+0000 mon.a (mon.0) 152 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:27:43.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:42.136851+0000 mon.a (mon.0) 153 : cluster [INF] osd.0 [v2:172.21.15.5:6802/2227803114,v1:172.21.15.5:6803/2227803114] boot 2024-02-17T23:27:43.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:42.136897+0000 mon.a (mon.0) 154 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-17T23:27:43.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:42.137335+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:27:43.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:43.139127+0000 mon.a (mon.0) 155 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-17T23:27:43.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.302150+0000 mgr.y (mgr.44106) 91 : audit [DBG] from='client.44190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:43.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.675765+0000 mgr.y (mgr.44106) 92 : audit [DBG] from='client.54151 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:43.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:41.956011+0000 mgr.y (mgr.44106) 93 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:43.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:41.956662+0000 mgr.y (mgr.44106) 94 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (17 PGs are or would become offline) 2024-02-17T23:27:43.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:42.133024+0000 mon.a (mon.0) 152 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:27:43.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:42.136851+0000 mon.a (mon.0) 153 : cluster [INF] osd.0 [v2:172.21.15.5:6802/2227803114,v1:172.21.15.5:6803/2227803114] boot 2024-02-17T23:27:43.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:42.136897+0000 mon.a (mon.0) 154 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2024-02-17T23:27:43.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:42.137335+0000 mon.c (mon.1) 115 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-02-17T23:27:43.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:43.139127+0000 mon.a (mon.0) 155 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2024-02-17T23:27:44.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:44 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:42.439038+0000 mgr.y (mgr.44106) 95 : audit [DBG] from='client.44208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:44.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:44 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:42.792105+0000 mgr.y (mgr.44106) 96 : cluster [DBG] pgmap v44: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:44.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:44 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:42.439038+0000 mgr.y (mgr.44106) 95 : audit [DBG] from='client.44208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:44.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:44 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:42.792105+0000 mgr.y (mgr.44106) 96 : cluster [DBG] pgmap v44: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:44.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:44 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:42.439038+0000 mgr.y (mgr.44106) 95 : audit [DBG] from='client.44208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:27:44.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:44 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:42.792105+0000 mgr.y (mgr.44106) 96 : cluster [DBG] pgmap v44: 129 pgs: 22 active+undersized+degraded, 27 active+undersized, 80 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:27:45.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:45.159463+0000 mon.a (mon.0) 156 : cluster [WRN] Health check update: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded (PG_DEGRADED) 2024-02-17T23:27:45.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:45.159463+0000 mon.a (mon.0) 156 : cluster [WRN] Health check update: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded (PG_DEGRADED) 2024-02-17T23:27:45.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:45.159463+0000 mon.a (mon.0) 156 : cluster [WRN] Health check update: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded (PG_DEGRADED) 2024-02-17T23:27:46.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:45 smithi080 bash[37749]: debug 2024-02-17T23:27:45.775+0000 7ff7e27e5700 -1 osd.4 71 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:46.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:45 smithi080 bash[37749]: debug 2024-02-17T23:27:45.775+0000 7ff7e6fee700 -1 osd.4 71 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:46.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:27:45 smithi080 bash[37749]: debug 2024-02-17T23:27:45.775+0000 7ff7e4fea700 -1 osd.4 71 build_incremental_map_msg missing incremental map 70 2024-02-17T23:27:46.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:44.792838+0000 mgr.y (mgr.44106) 97 : cluster [DBG] pgmap v46: 129 pgs: 8 active+undersized+degraded, 8 active+undersized, 113 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 29/606 objects degraded (4.785%) 2024-02-17T23:27:46.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:44.792838+0000 mgr.y (mgr.44106) 97 : cluster [DBG] pgmap v46: 129 pgs: 8 active+undersized+degraded, 8 active+undersized, 113 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 29/606 objects degraded (4.785%) 2024-02-17T23:27:46.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:44.792838+0000 mgr.y (mgr.44106) 97 : cluster [DBG] pgmap v46: 129 pgs: 8 active+undersized+degraded, 8 active+undersized, 113 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail; 29/606 objects degraded (4.785%) 2024-02-17T23:27:47.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:46.793374+0000 mgr.y (mgr.44106) 98 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:47.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:47.213113+0000 mon.a (mon.0) 157 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded) 2024-02-17T23:27:47.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:47.213166+0000 mon.a (mon.0) 158 : cluster [INF] Cluster is now healthy 2024-02-17T23:27:47.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:46.793374+0000 mgr.y (mgr.44106) 98 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:47.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:47.213113+0000 mon.a (mon.0) 157 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded) 2024-02-17T23:27:47.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:47.213166+0000 mon.a (mon.0) 158 : cluster [INF] Cluster is now healthy 2024-02-17T23:27:47.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:46.793374+0000 mgr.y (mgr.44106) 98 : cluster [DBG] pgmap v47: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:47.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:47.213113+0000 mon.a (mon.0) 157 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 29/606 objects degraded (4.785%), 8 pgs degraded) 2024-02-17T23:27:47.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:47.213166+0000 mon.a (mon.0) 158 : cluster [INF] Cluster is now healthy 2024-02-17T23:27:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:48.793967+0000 mgr.y (mgr.44106) 99 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:50.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:48.793967+0000 mgr.y (mgr.44106) 99 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:50.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:49 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:48.793967+0000 mgr.y (mgr.44106) 99 : cluster [DBG] pgmap v48: 129 pgs: 129 active+clean; 7.0 KiB data, 296 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:52.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:51 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:50.794815+0000 mgr.y (mgr.44106) 100 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:52.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:51 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:50.794815+0000 mgr.y (mgr.44106) 100 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:52.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:50.794815+0000 mgr.y (mgr.44106) 100 : cluster [DBG] pgmap v49: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:54.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:52.795278+0000 mgr.y (mgr.44106) 101 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:54.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:52.795278+0000 mgr.y (mgr.44106) 101 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:54.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:52.795278+0000 mgr.y (mgr.44106) 101 : cluster [DBG] pgmap v50: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:55.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:54.000735+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:55.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:54.000735+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:55.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:54.000735+0000 mon.a (mon.0) 159 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:54.795882+0000 mgr.y (mgr.44106) 102 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:56.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:54.795882+0000 mgr.y (mgr.44106) 102 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:56.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:54.795882+0000 mgr.y (mgr.44106) 102 : cluster [DBG] pgmap v51: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:57.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:56.972234+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:57.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:56.972234+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:57.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:56.972234+0000 mon.c (mon.1) 116 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:58.107 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:56.796458+0000 mgr.y (mgr.44106) 103 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:58.107 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:56.972448+0000 mgr.y (mgr.44106) 104 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:58.107 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:56.973516+0000 mgr.y (mgr.44106) 105 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-02-17T23:27:58.107 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:56.796458+0000 mgr.y (mgr.44106) 103 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:58.108 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:56.972448+0000 mgr.y (mgr.44106) 104 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:58.108 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:56.973516+0000 mgr.y (mgr.44106) 105 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-02-17T23:27:58.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:56.796458+0000 mgr.y (mgr.44106) 103 : cluster [DBG] pgmap v52: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:58.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:56.972448+0000 mgr.y (mgr.44106) 104 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-02-17T23:27:58.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:56.973516+0000 mgr.y (mgr.44106) 105 : cephadm [INF] Upgrade: osd.1 is safe to restart 2024-02-17T23:27:59.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:58.582919+0000 mgr.y (mgr.44106) 106 : cephadm [INF] Upgrade: Updating osd.1 2024-02-17T23:27:59.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:58.587909+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:59.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:58.588924+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-17T23:27:59.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:58.589556+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:59.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:27:58.590712+0000 mgr.y (mgr.44106) 107 : cephadm [INF] Deploying daemon osd.1 on smithi005 2024-02-17T23:27:59.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:27:58.591133+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-17T23:27:59.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:27:58.796774+0000 mgr.y (mgr.44106) 108 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:59.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:58.582919+0000 mgr.y (mgr.44106) 106 : cephadm [INF] Upgrade: Updating osd.1 2024-02-17T23:27:59.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:58.587909+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:59.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:58.588924+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-17T23:27:59.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:58.589556+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:59.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:27:58.590712+0000 mgr.y (mgr.44106) 107 : cephadm [INF] Deploying daemon osd.1 on smithi005 2024-02-17T23:27:59.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:27:58.591133+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-17T23:27:59.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:27:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:27:58.796774+0000 mgr.y (mgr.44106) 108 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:27:59.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:58.582919+0000 mgr.y (mgr.44106) 106 : cephadm [INF] Upgrade: Updating osd.1 2024-02-17T23:27:59.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:58.587909+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:27:59.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:58.588924+0000 mon.c (mon.1) 117 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-02-17T23:27:59.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:58.589556+0000 mon.c (mon.1) 118 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:27:59.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:27:58.590712+0000 mgr.y (mgr.44106) 107 : cephadm [INF] Deploying daemon osd.1 on smithi005 2024-02-17T23:27:59.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:27:58.591133+0000 mon.c (mon.1) 119 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "container_image"}]: dispatch 2024-02-17T23:27:59.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:27:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:27:58.796774+0000 mgr.y (mgr.44106) 108 : cluster [DBG] pgmap v53: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:28:01.853 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:01 smithi005 systemd[1]: Stopping Ceph osd.1 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:28:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:00.797333+0000 mgr.y (mgr.44106) 109 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:28:02.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:00.797333+0000 mgr.y (mgr.44106) 109 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:28:02.126 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:01 smithi005 bash[42328]: debug 2024-02-17T23:28:01.849+0000 7f912119b700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:28:02.127 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:01 smithi005 bash[42328]: debug 2024-02-17T23:28:01.849+0000 7f912119b700 -1 osd.1 71 *** Got signal Terminated *** 2024-02-17T23:28:02.127 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:01 smithi005 bash[42328]: debug 2024-02-17T23:28:01.849+0000 7f912119b700 -1 osd.1 71 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:28:02.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:00.797333+0000 mgr.y (mgr.44106) 109 : cluster [DBG] pgmap v54: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:28:02.626 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:02 smithi005 bash[65629]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.1 2024-02-17T23:28:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.094255+0000 mon.a (mon.0) 161 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.094298+0000 mon.a (mon.0) 162 : cluster [INF] osd.1 failed (root=default,host=smithi005) (connection refused reported by osd.6) 2024-02-17T23:28:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.094513+0000 mon.a (mon.0) 163 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.094614+0000 mon.a (mon.0) 164 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.094734+0000 mon.a (mon.0) 165 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.094836+0000 mon.a (mon.0) 166 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.094918+0000 mon.a (mon.0) 167 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.094988+0000 mon.a (mon.0) 168 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.095057+0000 mon.a (mon.0) 169 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.095146+0000 mon.a (mon.0) 170 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.095187+0000 mon.a (mon.0) 171 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.095321+0000 mon.a (mon.0) 172 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.095421+0000 mon.a (mon.0) 173 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.095495+0000 mon.a (mon.0) 174 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.095565+0000 mon.a (mon.0) 175 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.222585+0000 mon.a (mon.0) 176 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.222871+0000 mon.a (mon.0) 177 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.423269+0000 mon.a (mon.0) 178 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.423407+0000 mon.a (mon.0) 179 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.495290+0000 mon.a (mon.0) 180 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.094255+0000 mon.a (mon.0) 161 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.094298+0000 mon.a (mon.0) 162 : cluster [INF] osd.1 failed (root=default,host=smithi005) (connection refused reported by osd.6) 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.094513+0000 mon.a (mon.0) 163 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.094614+0000 mon.a (mon.0) 164 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.094734+0000 mon.a (mon.0) 165 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.094836+0000 mon.a (mon.0) 166 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.094918+0000 mon.a (mon.0) 167 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.094988+0000 mon.a (mon.0) 168 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.095057+0000 mon.a (mon.0) 169 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.095146+0000 mon.a (mon.0) 170 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.095187+0000 mon.a (mon.0) 171 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.095321+0000 mon.a (mon.0) 172 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.095421+0000 mon.a (mon.0) 173 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.095495+0000 mon.a (mon.0) 174 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.095565+0000 mon.a (mon.0) 175 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.222585+0000 mon.a (mon.0) 176 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.222871+0000 mon.a (mon.0) 177 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.423269+0000 mon.a (mon.0) 178 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.423407+0000 mon.a (mon.0) 179 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.495290+0000 mon.a (mon.0) 180 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.495390+0000 mon.a (mon.0) 181 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.495574+0000 mon.a (mon.0) 182 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.495692+0000 mon.a (mon.0) 183 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.495818+0000 mon.a (mon.0) 184 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.129 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.495933+0000 mon.a (mon.0) 185 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.496034+0000 mon.a (mon.0) 186 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.496126+0000 mon.a (mon.0) 187 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.496216+0000 mon.a (mon.0) 188 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.496310+0000 mon.a (mon.0) 189 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.496420+0000 mon.a (mon.0) 190 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.496536+0000 mon.a (mon.0) 191 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.496616+0000 mon.a (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.496695+0000 mon.a (mon.0) 193 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.824366+0000 mon.a (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.130 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.824509+0000 mon.a (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.495390+0000 mon.a (mon.0) 181 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.495574+0000 mon.a (mon.0) 182 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.495692+0000 mon.a (mon.0) 183 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.495818+0000 mon.a (mon.0) 184 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.495933+0000 mon.a (mon.0) 185 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.496034+0000 mon.a (mon.0) 186 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.496126+0000 mon.a (mon.0) 187 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.496216+0000 mon.a (mon.0) 188 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.496310+0000 mon.a (mon.0) 189 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.496420+0000 mon.a (mon.0) 190 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.496536+0000 mon.a (mon.0) 191 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.496616+0000 mon.a (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.131 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.496695+0000 mon.a (mon.0) 193 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.824366+0000 mon.a (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.132 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.824509+0000 mon.a (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.094255+0000 mon.a (mon.0) 161 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.094298+0000 mon.a (mon.0) 162 : cluster [INF] osd.1 failed (root=default,host=smithi005) (connection refused reported by osd.6) 2024-02-17T23:28:03.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.094513+0000 mon.a (mon.0) 163 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.094614+0000 mon.a (mon.0) 164 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.094734+0000 mon.a (mon.0) 165 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.094836+0000 mon.a (mon.0) 166 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.094918+0000 mon.a (mon.0) 167 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.094988+0000 mon.a (mon.0) 168 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.095057+0000 mon.a (mon.0) 169 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.095146+0000 mon.a (mon.0) 170 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.095187+0000 mon.a (mon.0) 171 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.095321+0000 mon.a (mon.0) 172 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.095421+0000 mon.a (mon.0) 173 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.095495+0000 mon.a (mon.0) 174 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.095565+0000 mon.a (mon.0) 175 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.222585+0000 mon.a (mon.0) 176 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.222871+0000 mon.a (mon.0) 177 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.423269+0000 mon.a (mon.0) 178 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.423407+0000 mon.a (mon.0) 179 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.495290+0000 mon.a (mon.0) 180 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.495390+0000 mon.a (mon.0) 181 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.495574+0000 mon.a (mon.0) 182 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.495692+0000 mon.a (mon.0) 183 : cluster [DBG] osd.1 reported immediately failed by osd.5 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.495818+0000 mon.a (mon.0) 184 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.495933+0000 mon.a (mon.0) 185 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.496034+0000 mon.a (mon.0) 186 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.496126+0000 mon.a (mon.0) 187 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.143 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.496216+0000 mon.a (mon.0) 188 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.143 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.496310+0000 mon.a (mon.0) 189 : cluster [DBG] osd.1 reported immediately failed by osd.7 2024-02-17T23:28:03.143 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.496420+0000 mon.a (mon.0) 190 : cluster [DBG] osd.1 reported immediately failed by osd.0 2024-02-17T23:28:03.143 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.496536+0000 mon.a (mon.0) 191 : cluster [DBG] osd.1 reported immediately failed by osd.4 2024-02-17T23:28:03.143 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.496616+0000 mon.a (mon.0) 192 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:03.143 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.496695+0000 mon.a (mon.0) 193 : cluster [DBG] osd.1 reported immediately failed by osd.2 2024-02-17T23:28:03.143 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.824366+0000 mon.a (mon.0) 194 : cluster [DBG] osd.1 reported immediately failed by osd.6 2024-02-17T23:28:03.143 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.824509+0000 mon.a (mon.0) 195 : cluster [DBG] osd.1 reported immediately failed by osd.3 2024-02-17T23:28:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.797741+0000 mgr.y (mgr.44106) 110 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:28:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.853237+0000 mon.a (mon.0) 196 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:28:04.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:02.863173+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2024-02-17T23:28:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.797741+0000 mgr.y (mgr.44106) 110 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:28:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.853237+0000 mon.a (mon.0) 196 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:28:04.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:02.863173+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2024-02-17T23:28:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.797741+0000 mgr.y (mgr.44106) 110 : cluster [DBG] pgmap v55: 129 pgs: 129 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail 2024-02-17T23:28:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.853237+0000 mon.a (mon.0) 196 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:28:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:02.863173+0000 mon.a (mon.0) 197 : cluster [DBG] osdmap e72: 8 total, 7 up, 8 in 2024-02-17T23:28:05.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:03.865587+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2024-02-17T23:28:05.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:03.865587+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2024-02-17T23:28:05.127 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:04 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.1.service: Succeeded. 2024-02-17T23:28:05.127 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:04 smithi005 systemd[1]: Stopped Ceph osd.1 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:28:05.127 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:04 smithi005 systemd[1]: Starting Ceph osd.1 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:28:05.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:03.865587+0000 mon.a (mon.0) 198 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2024-02-17T23:28:06.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:04.798659+0000 mgr.y (mgr.44106) 111 : cluster [DBG] pgmap v58: 129 pgs: 1 peering, 13 active+undersized+degraded, 20 activating+undersized, 1 stale+active+clean, 17 active+undersized, 77 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 79/606 objects degraded (13.036%) 2024-02-17T23:28:06.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:04.862878+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-17T23:28:06.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:04.862907+0000 mon.a (mon.0) 200 : cluster [WRN] Health check failed: Degraded data redundancy: 79/606 objects degraded (13.036%), 13 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:06.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:04.798659+0000 mgr.y (mgr.44106) 111 : cluster [DBG] pgmap v58: 129 pgs: 1 peering, 13 active+undersized+degraded, 20 activating+undersized, 1 stale+active+clean, 17 active+undersized, 77 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 79/606 objects degraded (13.036%) 2024-02-17T23:28:06.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:04.862878+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-17T23:28:06.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:04.862907+0000 mon.a (mon.0) 200 : cluster [WRN] Health check failed: Degraded data redundancy: 79/606 objects degraded (13.036%), 13 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:06.127 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:05 smithi005 bash[65926]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-17T23:28:06.128 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:05 smithi005 bash[65926]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-17T23:28:06.128 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:05 smithi005 bash[65926]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-02-17T23:28:06.128 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:05 smithi005 bash[65926]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-02-17T23:28:06.128 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:05 smithi005 bash[65926]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-02-17T23:28:06.128 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:05 smithi005 bash[65926]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-17T23:28:06.128 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:05 smithi005 bash[65926]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-02-17T23:28:06.128 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:05 smithi005 bash[65926]: --> ceph-volume lvm activate successful for osd ID: 1 2024-02-17T23:28:06.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:04.798659+0000 mgr.y (mgr.44106) 111 : cluster [DBG] pgmap v58: 129 pgs: 1 peering, 13 active+undersized+degraded, 20 activating+undersized, 1 stale+active+clean, 17 active+undersized, 77 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 79/606 objects degraded (13.036%) 2024-02-17T23:28:06.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:04.862878+0000 mon.a (mon.0) 199 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs inactive, 1 pg peering (PG_AVAILABILITY) 2024-02-17T23:28:06.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:04.862907+0000 mon.a (mon.0) 200 : cluster [WRN] Health check failed: Degraded data redundancy: 79/606 objects degraded (13.036%), 13 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:07.376 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-1[66193]: debug 2024-02-17T23:28:06.907+0000 7f52144b3700 1 -- 172.21.15.5:0/77717619 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556490664680 con 0x55649062b000 2024-02-17T23:28:07.376 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:07 smithi005 bash[66177]: ff7b364ab038424092d0c111291019f4ac7d0a521bd8a9ec1796087f24d7a4b5 2024-02-17T23:28:07.376 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:07 smithi005 systemd[1]: Started Ceph osd.1 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:28:07.876 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-1[66193]: debug 2024-02-17T23:28:07.429+0000 7f521bf41380 -1 Falling back to public interface 2024-02-17T23:28:08.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:06.799317+0000 mgr.y (mgr.44106) 112 : cluster [DBG] pgmap v59: 129 pgs: 1 peering, 14 active+undersized+degraded, 20 activating+undersized, 21 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 85/606 objects degraded (14.026%) 2024-02-17T23:28:08.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:07.058072+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:08.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:07.059270+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:08.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:07.060561+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:28:08.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:06.799317+0000 mgr.y (mgr.44106) 112 : cluster [DBG] pgmap v59: 129 pgs: 1 peering, 14 active+undersized+degraded, 20 activating+undersized, 21 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 85/606 objects degraded (14.026%) 2024-02-17T23:28:08.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:07.058072+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:08.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:07.059270+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:08.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:07.060561+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:28:08.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:06.799317+0000 mgr.y (mgr.44106) 112 : cluster [DBG] pgmap v59: 129 pgs: 1 peering, 14 active+undersized+degraded, 20 activating+undersized, 21 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 85/606 objects degraded (14.026%) 2024-02-17T23:28:08.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:07.058072+0000 mon.a (mon.0) 201 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:08.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:07.059270+0000 mon.c (mon.1) 120 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:08.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:07.060561+0000 mon.c (mon.1) 121 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:28:10.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:08.799715+0000 mgr.y (mgr.44106) 113 : cluster [DBG] pgmap v60: 129 pgs: 1 peering, 14 active+undersized+degraded, 20 activating+undersized, 21 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 85/606 objects degraded (14.026%) 2024-02-17T23:28:10.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:08.799715+0000 mgr.y (mgr.44106) 113 : cluster [DBG] pgmap v60: 129 pgs: 1 peering, 14 active+undersized+degraded, 20 activating+undersized, 21 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 85/606 objects degraded (14.026%) 2024-02-17T23:28:10.377 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-1[66193]: debug 2024-02-17T23:28:10.176+0000 7f521bf41380 -1 osd.1 71 log_to_monitors {default=true} 2024-02-17T23:28:10.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:08.799715+0000 mgr.y (mgr.44106) 113 : cluster [DBG] pgmap v60: 129 pgs: 1 peering, 14 active+undersized+degraded, 20 activating+undersized, 21 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 85/606 objects degraded (14.026%) 2024-02-17T23:28:11.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:10.180867+0000 mon.a (mon.0) 202 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-17T23:28:11.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:10.721033+0000 mon.a (mon.0) 203 : cluster [WRN] Health check update: Degraded data redundancy: 85/606 objects degraded (14.026%), 14 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:11.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:10.180867+0000 mon.a (mon.0) 202 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-17T23:28:11.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:10.721033+0000 mon.a (mon.0) 203 : cluster [WRN] Health check update: Degraded data redundancy: 85/606 objects degraded (14.026%), 14 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:11.377 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:28:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-1[66193]: debug 2024-02-17T23:28:11.085+0000 7f520b424700 -1 osd.1 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T23:28:11.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:10.180867+0000 mon.a (mon.0) 202 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-02-17T23:28:11.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:10.721033+0000 mon.a (mon.0) 203 : cluster [WRN] Health check update: Degraded data redundancy: 85/606 objects degraded (14.026%), 14 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:11.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:28:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:28:11.484+0000 7f36ce75d700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-02-17T23:28:12.376 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:28:12 smithi005 bash[45515]: debug 2024-02-17T23:28:12.078+0000 7f96981bd700 -1 osd.3 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.376 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:28:12 smithi005 bash[45515]: debug 2024-02-17T23:28:12.079+0000 7f96969ba700 -1 osd.3 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.376 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:28:12 smithi005 bash[45515]: debug 2024-02-17T23:28:12.079+0000 7f96989be700 -1 osd.3 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.376 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:28:12 smithi005 bash[45515]: debug 2024-02-17T23:28:12.079+0000 7f96981bd700 -1 osd.3 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.376 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:28:12 smithi005 bash[45515]: debug 2024-02-17T23:28:12.084+0000 7f96951b7700 -1 osd.3 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.376 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:28:12 smithi005 bash[45515]: debug 2024-02-17T23:28:12.085+0000 7f96961b9700 -1 osd.3 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:10.800325+0000 mgr.y (mgr.44106) 114 : cluster [DBG] pgmap v61: 129 pgs: 24 active+undersized+degraded, 32 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 86/606 objects degraded (14.191%) 2024-02-17T23:28:12.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:11.060612+0000 mon.a (mon.0) 204 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 1 pg peering) 2024-02-17T23:28:12.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:11.067253+0000 mon.a (mon.0) 205 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-17T23:28:12.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:11.067313+0000 mon.a (mon.0) 206 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2024-02-17T23:28:12.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:11.068469+0000 mon.a (mon.0) 207 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:28:12.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:11.470466+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:12.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:11.474835+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:12.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:11.479409+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:11.481782+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:11.482964+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:11.483840+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:11.484943+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:10.800325+0000 mgr.y (mgr.44106) 114 : cluster [DBG] pgmap v61: 129 pgs: 24 active+undersized+degraded, 32 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 86/606 objects degraded (14.191%) 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:11.060612+0000 mon.a (mon.0) 204 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 1 pg peering) 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:11.067253+0000 mon.a (mon.0) 205 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:11.067313+0000 mon.a (mon.0) 206 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:11.068469+0000 mon.a (mon.0) 207 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:11.470466+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:12.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:11.474835+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:12.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:11.479409+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:12.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:11.481782+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:12.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:11.482964+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:12.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:11.483840+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:12.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:11.484943+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:12.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[41341]: debug 2024-02-17T23:28:12.080+0000 7fea9f1b9700 -1 osd.6 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[41341]: debug 2024-02-17T23:28:12.081+0000 7fea9d9b6700 -1 osd.6 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[41341]: debug 2024-02-17T23:28:12.084+0000 7feaa49c4700 -1 osd.6 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[41341]: debug 2024-02-17T23:28:12.084+0000 7feaa11bd700 -1 osd.6 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[41341]: debug 2024-02-17T23:28:12.085+0000 7fea9f9ba700 -1 osd.6 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.390 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[37749]: debug 2024-02-17T23:28:12.080+0000 7ff7e7ff0700 -1 osd.4 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.390 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[37749]: debug 2024-02-17T23:28:12.080+0000 7ff7e47e9700 -1 osd.4 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.391 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[37749]: debug 2024-02-17T23:28:12.080+0000 7ff7e7ff0700 -1 osd.4 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.391 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[37749]: debug 2024-02-17T23:28:12.081+0000 7ff7e47e9700 -1 osd.4 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.391 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[37749]: debug 2024-02-17T23:28:12.081+0000 7ff7e7ff0700 -1 osd.4 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.391 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[37749]: debug 2024-02-17T23:28:12.083+0000 7ff7e37e7700 -1 osd.4 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.391 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[40758]: debug 2024-02-17T23:28:12.076+0000 7f7b0b065700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.391 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[40758]: debug 2024-02-17T23:28:12.077+0000 7f7b10870700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.391 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[40758]: debug 2024-02-17T23:28:12.078+0000 7f7b0a864700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.391 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[40758]: debug 2024-02-17T23:28:12.078+0000 7f7b0b866700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.392 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[40758]: debug 2024-02-17T23:28:12.079+0000 7f7b0a864700 -1 osd.5 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.392 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[42871]: debug 2024-02-17T23:28:12.075+0000 7f603a3cc700 -1 osd.7 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.392 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[42871]: debug 2024-02-17T23:28:12.075+0000 7f603bbcf700 -1 osd.7 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.392 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[42871]: debug 2024-02-17T23:28:12.075+0000 7f60383c8700 -1 osd.7 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.392 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[42871]: debug 2024-02-17T23:28:12.076+0000 7f603f3d6700 -1 osd.7 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.392 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:28:12 smithi080 bash[42871]: debug 2024-02-17T23:28:12.076+0000 7f60383c8700 -1 osd.7 75 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:12.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:10.800325+0000 mgr.y (mgr.44106) 114 : cluster [DBG] pgmap v61: 129 pgs: 24 active+undersized+degraded, 32 active+undersized, 73 active+clean; 7.0 KiB data, 297 MiB used, 708 GiB / 715 GiB avail; 86/606 objects degraded (14.191%) 2024-02-17T23:28:12.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:11.060612+0000 mon.a (mon.0) 204 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 1 pg peering) 2024-02-17T23:28:12.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:11.067253+0000 mon.a (mon.0) 205 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-02-17T23:28:12.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:11.067313+0000 mon.a (mon.0) 206 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2024-02-17T23:28:12.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:11.068469+0000 mon.a (mon.0) 207 : audit [INF] from='osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:28:12.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:11.470466+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:12.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:11.474835+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:12.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:11.479409+0000 mon.c (mon.1) 122 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:12.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:11.481782+0000 mon.c (mon.1) 123 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:12.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:11.482964+0000 mon.c (mon.1) 124 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:12.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:11.483840+0000 mon.c (mon.1) 125 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:12.394 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:11.484943+0000 mon.c (mon.1) 126 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:12.792 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:28:13.376 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:28:13 smithi005 bash[45515]: debug 2024-02-17T23:28:13.112+0000 7f96981bd700 -1 osd.3 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:13.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:11.485084+0000 mgr.y (mgr.44106) 115 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:13.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:28:11.485724+0000 mgr.y (mgr.44106) 116 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-02-17T23:28:13.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:12.067529+0000 mon.a (mon.0) 210 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:28:13.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:12.071762+0000 mon.a (mon.0) 211 : cluster [INF] osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624] boot 2024-02-17T23:28:13.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:12.071838+0000 mon.a (mon.0) 212 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-17T23:28:13.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:12.072296+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:28:13.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:11.485084+0000 mgr.y (mgr.44106) 115 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:13.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:28:11.485724+0000 mgr.y (mgr.44106) 116 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-02-17T23:28:13.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:12.067529+0000 mon.a (mon.0) 210 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:28:13.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:12.071762+0000 mon.a (mon.0) 211 : cluster [INF] osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624] boot 2024-02-17T23:28:13.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:12.071838+0000 mon.a (mon.0) 212 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-17T23:28:13.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:12.072296+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:28:13.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:28:13 smithi080 bash[41341]: debug 2024-02-17T23:28:13.112+0000 7feaa11bd700 -1 osd.6 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:13.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:28:13 smithi080 bash[41341]: debug 2024-02-17T23:28:13.221+0000 7fea9e9b8700 -1 osd.6 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:13.391 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:13 smithi080 bash[37749]: debug 2024-02-17T23:28:13.112+0000 7ff7e27e5700 -1 osd.4 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:13.391 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:13 smithi080 bash[37749]: debug 2024-02-17T23:28:13.112+0000 7ff7e2fe6700 -1 osd.4 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:13.391 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:13 smithi080 bash[37749]: debug 2024-02-17T23:28:13.112+0000 7ff7e4fea700 -1 osd.4 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:13.391 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:28:13 smithi080 bash[40758]: debug 2024-02-17T23:28:13.112+0000 7f7b0b065700 -1 osd.5 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:13.391 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:28:13 smithi080 bash[40758]: debug 2024-02-17T23:28:13.112+0000 7f7b0f86e700 -1 osd.5 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:13.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:11.485084+0000 mgr.y (mgr.44106) 115 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:13.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:28:11.485724+0000 mgr.y (mgr.44106) 116 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-02-17T23:28:13.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:12.067529+0000 mon.a (mon.0) 210 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:28:13.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:12.071762+0000 mon.a (mon.0) 211 : cluster [INF] osd.1 [v2:172.21.15.5:6810/2171307624,v1:172.21.15.5:6811/2171307624] boot 2024-02-17T23:28:13.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:12.071838+0000 mon.a (mon.0) 212 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2024-02-17T23:28:13.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:12.072296+0000 mon.c (mon.1) 127 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-02-17T23:28:13.460 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (3m) 1s ago 8m 22.5M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (8m) 70s ago 8m 34.4M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (2m) 70s ago 12m 383M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (2m) 1s ago 14m 421M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (118s) 1s ago 14m 49.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (82s) 70s ago 12m 26.5M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (93s) 1s ago 13m 43.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (9m) 1s ago 9m 12.4M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (9m) 70s ago 9m 13.7M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (36s) 1s ago 12m 40.0M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (6s) 1s ago 11m 10.8M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (11m) 1s ago 11m 45.5M 4096M 15.2.0 204a01f9b0b6 d35b8f2f65a2 2024-02-17T23:28:13.461 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (11m) 1s ago 11m 45.5M 4096M 15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:28:13.462 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (10m) 70s ago 10m 45.1M 4096M 15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:28:13.462 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (10m) 70s ago 10m 41.9M 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:28:13.462 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (10m) 70s ago 10m 41.5M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:28:13.462 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (9m) 70s ago 9m 45.1M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:28:13.462 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (3m) 70s ago 9m 37.8M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:28:13.462 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (7m) 1s ago 7m 37.8M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:28:13.462 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (7m) 70s ago 7m 39.0M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:28:13.849 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:28:13.849 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:28:13.849 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:28:13.849 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:28:13.850 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 8, 2024-02-17T23:28:13.851 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 7 2024-02-17T23:28:13.851 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:28:13.851 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:28:14.179 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:28:14.179 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:28:14.179 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:28:14.179 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:28:14.179 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:28:14.179 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:28:14.179 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-02-17T23:28:14.179 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:28:14.179 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "7/20 daemons upgraded", 2024-02-17T23:28:14.180 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-02-17T23:28:14.180 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:28:14.180 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:28:14.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:12.779585+0000 mgr.y (mgr.44106) 117 : audit [DBG] from='client.54175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:14.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:12.800721+0000 mgr.y (mgr.44106) 118 : cluster [DBG] pgmap v64: 129 pgs: 24 active+undersized+degraded, 32 active+undersized, 73 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 86/606 objects degraded (14.191%) 2024-02-17T23:28:14.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:13.077154+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-17T23:28:14.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.126550+0000 mgr.y (mgr.44106) 119 : audit [DBG] from='client.44226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.449708+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.450058+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.450369+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.450694+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.451001+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.451306+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.452968+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.453295+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.453603+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.453906+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.454218+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.848159+0000 mon.c (mon.1) 139 : audit [DBG] from='client.54193 172.21.15.5:0/3320400674' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:12.779585+0000 mgr.y (mgr.44106) 117 : audit [DBG] from='client.54175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:12.800721+0000 mgr.y (mgr.44106) 118 : cluster [DBG] pgmap v64: 129 pgs: 24 active+undersized+degraded, 32 active+undersized, 73 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 86/606 objects degraded (14.191%) 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:13.077154+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.126550+0000 mgr.y (mgr.44106) 119 : audit [DBG] from='client.44226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.449708+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.450058+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.450369+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.450694+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.451001+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.451306+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.452968+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.453295+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.453603+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.453906+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.454218+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.848159+0000 mon.c (mon.1) 139 : audit [DBG] from='client.54193 172.21.15.5:0/3320400674' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:12.779585+0000 mgr.y (mgr.44106) 117 : audit [DBG] from='client.54175 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:12.800721+0000 mgr.y (mgr.44106) 118 : cluster [DBG] pgmap v64: 129 pgs: 24 active+undersized+degraded, 32 active+undersized, 73 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 86/606 objects degraded (14.191%) 2024-02-17T23:28:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:13.077154+0000 mon.a (mon.0) 213 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2024-02-17T23:28:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.126550+0000 mgr.y (mgr.44106) 119 : audit [DBG] from='client.44226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.449708+0000 mon.c (mon.1) 128 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.450058+0000 mon.c (mon.1) 129 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.450369+0000 mon.c (mon.1) 130 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.450694+0000 mon.c (mon.1) 131 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.451001+0000 mon.c (mon.1) 132 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.451306+0000 mon.c (mon.1) 133 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.452968+0000 mon.c (mon.1) 134 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:14.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.453295+0000 mon.c (mon.1) 135 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.453603+0000 mon.c (mon.1) 136 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.453906+0000 mon.c (mon.1) 137 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.454218+0000 mon.c (mon.1) 138 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:14.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.848159+0000 mon.c (mon.1) 139 : audit [DBG] from='client.54193 172.21.15.5:0/3320400674' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:13.447918+0000 mgr.y (mgr.44106) 120 : audit [DBG] from='client.54187 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:14.177586+0000 mgr.y (mgr.44106) 121 : audit [DBG] from='client.44244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:15.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:13.447918+0000 mgr.y (mgr.44106) 120 : audit [DBG] from='client.54187 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:15.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:14.177586+0000 mgr.y (mgr.44106) 121 : audit [DBG] from='client.44244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:15.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:13.447918+0000 mgr.y (mgr.44106) 120 : audit [DBG] from='client.54187 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:15.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:14.177586+0000 mgr.y (mgr.44106) 121 : audit [DBG] from='client.44244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:16.084 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:28:15 smithi005 bash[45515]: debug 2024-02-17T23:28:15.781+0000 7f969c1c5700 -1 osd.3 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:16.084 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:28:15 smithi005 bash[45515]: debug 2024-02-17T23:28:15.781+0000 7f969a1c1700 -1 osd.3 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:16.085 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:28:15 smithi080 bash[40758]: debug 2024-02-17T23:28:15.782+0000 7f7b0f06d700 -1 osd.5 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:16.085 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:28:15 smithi080 bash[40758]: debug 2024-02-17T23:28:15.782+0000 7f7b0f86e700 -1 osd.5 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:16.085 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:15 smithi080 bash[37749]: debug 2024-02-17T23:28:15.782+0000 7ff7e67ed700 -1 osd.4 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:16.085 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:15 smithi080 bash[37749]: debug 2024-02-17T23:28:15.782+0000 7ff7e6fee700 -1 osd.4 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:16.085 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:28:15 smithi080 bash[37749]: debug 2024-02-17T23:28:15.782+0000 7ff7e8ff2700 -1 osd.4 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:16.086 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:28:15 smithi080 bash[41341]: debug 2024-02-17T23:28:15.782+0000 7feaa11bd700 -1 osd.6 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:16.086 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:28:15 smithi080 bash[41341]: debug 2024-02-17T23:28:15.893+0000 7fea9e9b8700 -1 osd.6 76 build_incremental_map_msg missing incremental map 75 2024-02-17T23:28:16.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:14.801544+0000 mgr.y (mgr.44106) 122 : cluster [DBG] pgmap v66: 129 pgs: 9 active+undersized+degraded, 13 active+undersized, 107 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 37/606 objects degraded (6.106%) 2024-02-17T23:28:16.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:15.721597+0000 mon.a (mon.0) 214 : cluster [WRN] Health check update: Degraded data redundancy: 37/606 objects degraded (6.106%), 9 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:16.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:14.801544+0000 mgr.y (mgr.44106) 122 : cluster [DBG] pgmap v66: 129 pgs: 9 active+undersized+degraded, 13 active+undersized, 107 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 37/606 objects degraded (6.106%) 2024-02-17T23:28:16.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:15.721597+0000 mon.a (mon.0) 214 : cluster [WRN] Health check update: Degraded data redundancy: 37/606 objects degraded (6.106%), 9 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:16.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:14.801544+0000 mgr.y (mgr.44106) 122 : cluster [DBG] pgmap v66: 129 pgs: 9 active+undersized+degraded, 13 active+undersized, 107 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 37/606 objects degraded (6.106%) 2024-02-17T23:28:16.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:15.721597+0000 mon.a (mon.0) 214 : cluster [WRN] Health check update: Degraded data redundancy: 37/606 objects degraded (6.106%), 9 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:17.083209+0000 mon.a (mon.0) 215 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/606 objects degraded (6.106%), 9 pgs degraded) 2024-02-17T23:28:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:17.083264+0000 mon.a (mon.0) 216 : cluster [INF] Cluster is now healthy 2024-02-17T23:28:17.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:17.083209+0000 mon.a (mon.0) 215 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/606 objects degraded (6.106%), 9 pgs degraded) 2024-02-17T23:28:17.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:17.083264+0000 mon.a (mon.0) 216 : cluster [INF] Cluster is now healthy 2024-02-17T23:28:17.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:17.083209+0000 mon.a (mon.0) 215 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/606 objects degraded (6.106%), 9 pgs degraded) 2024-02-17T23:28:17.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:17.083264+0000 mon.a (mon.0) 216 : cluster [INF] Cluster is now healthy 2024-02-17T23:28:18.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:16.802152+0000 mgr.y (mgr.44106) 123 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:18.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:16.802152+0000 mgr.y (mgr.44106) 123 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:18.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:16.802152+0000 mgr.y (mgr.44106) 123 : cluster [DBG] pgmap v67: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:20.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:18.802575+0000 mgr.y (mgr.44106) 124 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:20.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:18.802575+0000 mgr.y (mgr.44106) 124 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:20.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:18.802575+0000 mgr.y (mgr.44106) 124 : cluster [DBG] pgmap v68: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:22.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:20.803235+0000 mgr.y (mgr.44106) 125 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:22.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:20.803235+0000 mgr.y (mgr.44106) 125 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:22.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:20.803235+0000 mgr.y (mgr.44106) 125 : cluster [DBG] pgmap v69: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:24.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:22.803762+0000 mgr.y (mgr.44106) 126 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:24.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:24.018765+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:24.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:22.803762+0000 mgr.y (mgr.44106) 126 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:24.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:24.018765+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:24.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:22.803762+0000 mgr.y (mgr.44106) 126 : cluster [DBG] pgmap v70: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:24.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:24.018765+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:26.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:24.804447+0000 mgr.y (mgr.44106) 127 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:26.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:24.804447+0000 mgr.y (mgr.44106) 127 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:26.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:24.804447+0000 mgr.y (mgr.44106) 127 : cluster [DBG] pgmap v71: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:27.301 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:26.501296+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:27.302 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:26.501296+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:27.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:26.501296+0000 mon.c (mon.1) 140 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:28.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:26.501506+0000 mgr.y (mgr.44106) 128 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:28.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:28:26.502609+0000 mgr.y (mgr.44106) 129 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-02-17T23:28:28.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:26.805090+0000 mgr.y (mgr.44106) 130 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:28.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.064100+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:28.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.065050+0000 mon.c (mon.1) 141 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-17T23:28:28.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.065691+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:28:28.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.067387+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-17T23:28:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:26.501506+0000 mgr.y (mgr.44106) 128 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:28:26.502609+0000 mgr.y (mgr.44106) 129 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-02-17T23:28:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:26.805090+0000 mgr.y (mgr.44106) 130 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.064100+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.065050+0000 mon.c (mon.1) 141 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-17T23:28:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.065691+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:28:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.067387+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-17T23:28:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:26.501506+0000 mgr.y (mgr.44106) 128 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-02-17T23:28:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:28:26.502609+0000 mgr.y (mgr.44106) 129 : cephadm [INF] Upgrade: osd.2 is safe to restart 2024-02-17T23:28:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:26.805090+0000 mgr.y (mgr.44106) 130 : cluster [DBG] pgmap v72: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.064100+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.065050+0000 mon.c (mon.1) 141 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-02-17T23:28:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.065691+0000 mon.c (mon.1) 142 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:28:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.067387+0000 mon.c (mon.1) 143 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "container_image"}]: dispatch 2024-02-17T23:28:29.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:28:28.059455+0000 mgr.y (mgr.44106) 131 : cephadm [INF] Upgrade: Updating osd.2 2024-02-17T23:28:29.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:28:28.066935+0000 mgr.y (mgr.44106) 132 : cephadm [INF] Deploying daemon osd.2 on smithi005 2024-02-17T23:28:29.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.816942+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-17T23:28:29.461 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.817178+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.817349+0000 mon.c (mon.1) 146 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.817361+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.817590+0000 mon.c (mon.1) 147 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.817811+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.818063+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:28.818583+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:28:28.059455+0000 mgr.y (mgr.44106) 131 : cephadm [INF] Upgrade: Updating osd.2 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:28:28.066935+0000 mgr.y (mgr.44106) 132 : cephadm [INF] Deploying daemon osd.2 on smithi005 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.816942+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.817178+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.817349+0000 mon.c (mon.1) 146 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:28:29.462 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.817361+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-17T23:28:29.463 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.817590+0000 mon.c (mon.1) 147 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.463 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.817811+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.463 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.818063+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:28:29.463 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:28.818583+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:28:28.059455+0000 mgr.y (mgr.44106) 131 : cephadm [INF] Upgrade: Updating osd.2 2024-02-17T23:28:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:28:28.066935+0000 mgr.y (mgr.44106) 132 : cephadm [INF] Deploying daemon osd.2 on smithi005 2024-02-17T23:28:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.816942+0000 mon.c (mon.1) 144 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-17T23:28:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.817178+0000 mon.c (mon.1) 145 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.817349+0000 mon.c (mon.1) 146 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:28:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.817361+0000 mon.a (mon.0) 219 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.3", "id": [7, 4]}]: dispatch 2024-02-17T23:28:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.817590+0000 mon.c (mon.1) 147 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.817811+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:28:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.818063+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [1, 5]}]: dispatch 2024-02-17T23:28:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:28.818583+0000 mon.a (mon.0) 222 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1b", "id": [1, 2]}]: dispatch 2024-02-17T23:28:30.572 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:28.805404+0000 mgr.y (mgr.44106) 133 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:30.572 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:28.805404+0000 mgr.y (mgr.44106) 133 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:30.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:30 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:28.805404+0000 mgr.y (mgr.44106) 133 : cluster [DBG] pgmap v73: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:31.304 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:31 smithi005 systemd[1]: Stopping Ceph osd.2 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:28:31.304 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:31 smithi005 bash[43923]: debug 2024-02-17T23:28:31.300+0000 7f14925f8700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:28:31.304 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:31 smithi005 bash[43923]: debug 2024-02-17T23:28:31.300+0000 7f14925f8700 -1 osd.2 76 *** Got signal Terminated *** 2024-02-17T23:28:31.304 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:31 smithi005 bash[43923]: debug 2024-02-17T23:28:31.300+0000 7f14925f8700 -1 osd.2 76 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:28:32.078 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:31 smithi005 bash[67363]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.2 2024-02-17T23:28:32.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:30.806255+0000 mgr.y (mgr.44106) 134 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:32.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.547234+0000 mon.a (mon.0) 223 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.547273+0000 mon.a (mon.0) 224 : cluster [INF] osd.2 failed (root=default,host=smithi005) (connection refused reported by osd.6) 2024-02-17T23:28:32.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.547469+0000 mon.a (mon.0) 225 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.547514+0000 mon.a (mon.0) 226 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.547614+0000 mon.a (mon.0) 227 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.547695+0000 mon.a (mon.0) 228 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.547765+0000 mon.a (mon.0) 229 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.547836+0000 mon.a (mon.0) 230 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.547935+0000 mon.a (mon.0) 231 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.548005+0000 mon.a (mon.0) 232 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.548110+0000 mon.a (mon.0) 233 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.548181+0000 mon.a (mon.0) 234 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.548275+0000 mon.a (mon.0) 235 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.548345+0000 mon.a (mon.0) 236 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.548441+0000 mon.a (mon.0) 237 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.768642+0000 mon.a (mon.0) 238 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.768784+0000 mon.a (mon.0) 239 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.768831+0000 mon.a (mon.0) 240 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.768929+0000 mon.a (mon.0) 241 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:30.806255+0000 mgr.y (mgr.44106) 134 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.547234+0000 mon.a (mon.0) 223 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.547273+0000 mon.a (mon.0) 224 : cluster [INF] osd.2 failed (root=default,host=smithi005) (connection refused reported by osd.6) 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.547469+0000 mon.a (mon.0) 225 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.547514+0000 mon.a (mon.0) 226 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.547614+0000 mon.a (mon.0) 227 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.547695+0000 mon.a (mon.0) 228 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.547765+0000 mon.a (mon.0) 229 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.547836+0000 mon.a (mon.0) 230 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.547935+0000 mon.a (mon.0) 231 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.548005+0000 mon.a (mon.0) 232 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.548110+0000 mon.a (mon.0) 233 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.548181+0000 mon.a (mon.0) 234 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.548275+0000 mon.a (mon.0) 235 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.548345+0000 mon.a (mon.0) 236 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.548441+0000 mon.a (mon.0) 237 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.768642+0000 mon.a (mon.0) 238 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.768784+0000 mon.a (mon.0) 239 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.768831+0000 mon.a (mon.0) 240 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.768929+0000 mon.a (mon.0) 241 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.948352+0000 mon.a (mon.0) 242 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.948497+0000 mon.a (mon.0) 243 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.948572+0000 mon.a (mon.0) 244 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.948677+0000 mon.a (mon.0) 245 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.948749+0000 mon.a (mon.0) 246 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.948818+0000 mon.a (mon.0) 247 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.948885+0000 mon.a (mon.0) 248 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.948953+0000 mon.a (mon.0) 249 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.949020+0000 mon.a (mon.0) 250 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.949134+0000 mon.a (mon.0) 251 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.949234+0000 mon.a (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.949314+0000 mon.a (mon.0) 253 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.949382+0000 mon.a (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.949485+0000 mon.a (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.969256+0000 mon.a (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.970159+0000 mon.a (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.970240+0000 mon.a (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:31.970309+0000 mon.a (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.948352+0000 mon.a (mon.0) 242 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.948497+0000 mon.a (mon.0) 243 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.948572+0000 mon.a (mon.0) 244 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.948677+0000 mon.a (mon.0) 245 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.948749+0000 mon.a (mon.0) 246 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.948818+0000 mon.a (mon.0) 247 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.948885+0000 mon.a (mon.0) 248 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.948953+0000 mon.a (mon.0) 249 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.949020+0000 mon.a (mon.0) 250 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.949134+0000 mon.a (mon.0) 251 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.949234+0000 mon.a (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.631 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.949314+0000 mon.a (mon.0) 253 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.949382+0000 mon.a (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.949485+0000 mon.a (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.969256+0000 mon.a (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.970159+0000 mon.a (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.970240+0000 mon.a (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:31.970309+0000 mon.a (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:30.806255+0000 mgr.y (mgr.44106) 134 : cluster [DBG] pgmap v74: 129 pgs: 129 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:32.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.547234+0000 mon.a (mon.0) 223 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.547273+0000 mon.a (mon.0) 224 : cluster [INF] osd.2 failed (root=default,host=smithi005) (connection refused reported by osd.6) 2024-02-17T23:28:32.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.547469+0000 mon.a (mon.0) 225 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.547514+0000 mon.a (mon.0) 226 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.547614+0000 mon.a (mon.0) 227 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.547695+0000 mon.a (mon.0) 228 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.547765+0000 mon.a (mon.0) 229 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.547836+0000 mon.a (mon.0) 230 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.547935+0000 mon.a (mon.0) 231 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.548005+0000 mon.a (mon.0) 232 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.548110+0000 mon.a (mon.0) 233 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.548181+0000 mon.a (mon.0) 234 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.548275+0000 mon.a (mon.0) 235 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.548345+0000 mon.a (mon.0) 236 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.548441+0000 mon.a (mon.0) 237 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.768642+0000 mon.a (mon.0) 238 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.768784+0000 mon.a (mon.0) 239 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.768831+0000 mon.a (mon.0) 240 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.768929+0000 mon.a (mon.0) 241 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.948352+0000 mon.a (mon.0) 242 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.948497+0000 mon.a (mon.0) 243 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.948572+0000 mon.a (mon.0) 244 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.948677+0000 mon.a (mon.0) 245 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.948749+0000 mon.a (mon.0) 246 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.948818+0000 mon.a (mon.0) 247 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.948885+0000 mon.a (mon.0) 248 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.948953+0000 mon.a (mon.0) 249 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.949020+0000 mon.a (mon.0) 250 : cluster [DBG] osd.2 reported immediately failed by osd.1 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.949134+0000 mon.a (mon.0) 251 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.949234+0000 mon.a (mon.0) 252 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.949314+0000 mon.a (mon.0) 253 : cluster [DBG] osd.2 reported immediately failed by osd.6 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.949382+0000 mon.a (mon.0) 254 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.949485+0000 mon.a (mon.0) 255 : cluster [DBG] osd.2 reported immediately failed by osd.0 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.969256+0000 mon.a (mon.0) 256 : cluster [DBG] osd.2 reported immediately failed by osd.3 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.970159+0000 mon.a (mon.0) 257 : cluster [DBG] osd.2 reported immediately failed by osd.4 2024-02-17T23:28:32.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.970240+0000 mon.a (mon.0) 258 : cluster [DBG] osd.2 reported immediately failed by osd.7 2024-02-17T23:28:32.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:31.970309+0000 mon.a (mon.0) 259 : cluster [DBG] osd.2 reported immediately failed by osd.5 2024-02-17T23:28:33.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:32.161747+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:28:33.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:32.165687+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2024-02-17T23:28:33.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:33.166908+0000 mon.a (mon.0) 262 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2024-02-17T23:28:33.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:32.161747+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:28:33.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:32.165687+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2024-02-17T23:28:33.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:33.166908+0000 mon.a (mon.0) 262 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2024-02-17T23:28:33.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:32.161747+0000 mon.a (mon.0) 260 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:28:33.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:32.165687+0000 mon.a (mon.0) 261 : cluster [DBG] osdmap e77: 8 total, 7 up, 8 in 2024-02-17T23:28:33.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:33.166908+0000 mon.a (mon.0) 262 : cluster [DBG] osdmap e78: 8 total, 7 up, 8 in 2024-02-17T23:28:34.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:32.806576+0000 mgr.y (mgr.44106) 135 : cluster [DBG] pgmap v76: 129 pgs: 10 stale+active+clean, 119 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:34.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:32.806576+0000 mgr.y (mgr.44106) 135 : cluster [DBG] pgmap v76: 129 pgs: 10 stale+active+clean, 119 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:34.377 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:33 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.2.service: Succeeded. 2024-02-17T23:28:34.377 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:33 smithi005 systemd[1]: Stopped Ceph osd.2 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:28:34.377 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:34 smithi005 systemd[1]: Starting Ceph osd.2 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:28:34.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:32.806576+0000 mgr.y (mgr.44106) 135 : cluster [DBG] pgmap v76: 129 pgs: 10 stale+active+clean, 119 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:35.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:34.807307+0000 mgr.y (mgr.44106) 136 : cluster [DBG] pgmap v78: 129 pgs: 7 active+undersized+degraded, 4 stale+active+clean, 14 active+undersized, 104 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 27/606 objects degraded (4.455%) 2024-02-17T23:28:35.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:35.183814+0000 mon.a (mon.0) 263 : cluster [WRN] Health check failed: Degraded data redundancy: 27/606 objects degraded (4.455%), 7 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:35.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:34.807307+0000 mgr.y (mgr.44106) 136 : cluster [DBG] pgmap v78: 129 pgs: 7 active+undersized+degraded, 4 stale+active+clean, 14 active+undersized, 104 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 27/606 objects degraded (4.455%) 2024-02-17T23:28:35.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:35.183814+0000 mon.a (mon.0) 263 : cluster [WRN] Health check failed: Degraded data redundancy: 27/606 objects degraded (4.455%), 7 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:35.377 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:35 smithi005 bash[67666]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-17T23:28:35.377 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:35 smithi005 bash[67666]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-17T23:28:35.377 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:35 smithi005 bash[67666]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-02-17T23:28:35.377 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:35 smithi005 bash[67666]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-02-17T23:28:35.377 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:35 smithi005 bash[67666]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-02-17T23:28:35.377 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:35 smithi005 bash[67666]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-17T23:28:35.378 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:35 smithi005 bash[67666]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-02-17T23:28:35.378 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:35 smithi005 bash[67666]: --> ceph-volume lvm activate successful for osd ID: 2 2024-02-17T23:28:35.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:34.807307+0000 mgr.y (mgr.44106) 136 : cluster [DBG] pgmap v78: 129 pgs: 7 active+undersized+degraded, 4 stale+active+clean, 14 active+undersized, 104 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 27/606 objects degraded (4.455%) 2024-02-17T23:28:35.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:35.183814+0000 mon.a (mon.0) 263 : cluster [WRN] Health check failed: Degraded data redundancy: 27/606 objects degraded (4.455%), 7 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:36.626 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-2[67931]: debug 2024-02-17T23:28:36.299+0000 7fc41e339700 1 -- 172.21.15.5:0/4055630600 <== mon.1 v2:172.21.15.5:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556030f04680 con 0x556030ecb800 2024-02-17T23:28:36.626 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:36 smithi005 bash[67916]: f9b5c6109867f06f9c860b882b023c7fa7079bf4dcf5b0fe99cff1605dea1d74 2024-02-17T23:28:36.626 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:36 smithi005 systemd[1]: Started Ceph osd.2 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:28:37.126 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-2[67931]: debug 2024-02-17T23:28:36.817+0000 7fc425dc7380 -1 Falling back to public interface 2024-02-17T23:28:37.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:36.417830+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:37.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:36.419028+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:37.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:36.420336+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:28:37.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:36.807834+0000 mgr.y (mgr.44106) 137 : cluster [DBG] pgmap v79: 129 pgs: 10 active+undersized+degraded, 22 active+undersized, 97 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 50/606 objects degraded (8.251%) 2024-02-17T23:28:37.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:36.417830+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:37.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:36.419028+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:37.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:36.420336+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:28:37.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:36.807834+0000 mgr.y (mgr.44106) 137 : cluster [DBG] pgmap v79: 129 pgs: 10 active+undersized+degraded, 22 active+undersized, 97 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 50/606 objects degraded (8.251%) 2024-02-17T23:28:37.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:36.417830+0000 mon.a (mon.0) 264 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:37.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:36.419028+0000 mon.c (mon.1) 148 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:37.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:36.420336+0000 mon.c (mon.1) 149 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:28:37.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:36.807834+0000 mgr.y (mgr.44106) 137 : cluster [DBG] pgmap v79: 129 pgs: 10 active+undersized+degraded, 22 active+undersized, 97 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 50/606 objects degraded (8.251%) 2024-02-17T23:28:39.868 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-2[67931]: debug 2024-02-17T23:28:39.542+0000 7fc425dc7380 -1 osd.2 76 log_to_monitors {default=true} 2024-02-17T23:28:40.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:38.808230+0000 mgr.y (mgr.44106) 138 : cluster [DBG] pgmap v80: 129 pgs: 10 active+undersized+degraded, 22 active+undersized, 97 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 50/606 objects degraded (8.251%) 2024-02-17T23:28:40.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:39.546190+0000 mon.c (mon.1) 150 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/1278159410,v1:172.21.15.5:6819/1278159410]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:28:40.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:39.546492+0000 mon.a (mon.0) 265 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:28:40.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:38.808230+0000 mgr.y (mgr.44106) 138 : cluster [DBG] pgmap v80: 129 pgs: 10 active+undersized+degraded, 22 active+undersized, 97 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 50/606 objects degraded (8.251%) 2024-02-17T23:28:40.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:39.546190+0000 mon.c (mon.1) 150 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/1278159410,v1:172.21.15.5:6819/1278159410]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:28:40.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:39.546492+0000 mon.a (mon.0) 265 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:28:40.127 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:28:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-2[67931]: debug 2024-02-17T23:28:39.876+0000 7fc4152aa700 -1 osd.2 76 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T23:28:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:38.808230+0000 mgr.y (mgr.44106) 138 : cluster [DBG] pgmap v80: 129 pgs: 10 active+undersized+degraded, 22 active+undersized, 97 active+clean; 7.0 KiB data, 587 MiB used, 709 GiB / 715 GiB avail; 50/606 objects degraded (8.251%) 2024-02-17T23:28:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:39.546190+0000 mon.c (mon.1) 150 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/1278159410,v1:172.21.15.5:6819/1278159410]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:28:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:39.546492+0000 mon.a (mon.0) 265 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-02-17T23:28:41.126 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:28:40.718+0000 7f36ce75d700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-02-17T23:28:41.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:39.864868+0000 mon.a (mon.0) 266 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-17T23:28:41.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:39.864951+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2024-02-17T23:28:41.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:39.866277+0000 mon.c (mon.1) 151 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/1278159410,v1:172.21.15.5:6819/1278159410]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:28:41.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:39.869461+0000 mon.a (mon.0) 268 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:28:41.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:40.704436+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:41.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:40.708593+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:41.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:40.713431+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:41.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:40.715770+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:41.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:40.716945+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:41.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:40.717822+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:41.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:40.718921+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:41.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:40.725149+0000 mon.a (mon.0) 271 : cluster [WRN] Health check update: Degraded data redundancy: 50/606 objects degraded (8.251%), 10 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:41.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:39.864868+0000 mon.a (mon.0) 266 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:39.864951+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:39.866277+0000 mon.c (mon.1) 151 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/1278159410,v1:172.21.15.5:6819/1278159410]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:39.869461+0000 mon.a (mon.0) 268 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:40.704436+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:40.708593+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:40.713431+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:40.715770+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:40.716945+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:40.717822+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:40.718921+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:41.128 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:40.725149+0000 mon.a (mon.0) 271 : cluster [WRN] Health check update: Degraded data redundancy: 50/606 objects degraded (8.251%), 10 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:39.864868+0000 mon.a (mon.0) 266 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-02-17T23:28:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:39.864951+0000 mon.a (mon.0) 267 : cluster [DBG] osdmap e79: 8 total, 7 up, 8 in 2024-02-17T23:28:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:39.866277+0000 mon.c (mon.1) 151 : audit [INF] from='osd.2 [v2:172.21.15.5:6818/1278159410,v1:172.21.15.5:6819/1278159410]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:28:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:39.869461+0000 mon.a (mon.0) 268 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:28:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:40.704436+0000 mon.a (mon.0) 269 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:40.708593+0000 mon.a (mon.0) 270 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:40.713431+0000 mon.c (mon.1) 152 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:28:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:40.715770+0000 mon.c (mon.1) 153 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:41.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:40.716945+0000 mon.c (mon.1) 154 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:41.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:40.717822+0000 mon.c (mon.1) 155 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:41.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:40.718921+0000 mon.c (mon.1) 156 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:41.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:40.725149+0000 mon.a (mon.0) 271 : cluster [WRN] Health check update: Degraded data redundancy: 50/606 objects degraded (8.251%), 10 pgs degraded (PG_DEGRADED) 2024-02-17T23:28:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:40.719049+0000 mgr.y (mgr.44106) 139 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:28:40.719664+0000 mgr.y (mgr.44106) 140 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-02-17T23:28:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:40.808797+0000 mgr.y (mgr.44106) 141 : cluster [DBG] pgmap v82: 129 pgs: 10 active+undersized+degraded, 22 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 50/606 objects degraded (8.251%) 2024-02-17T23:28:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:40.867141+0000 mon.a (mon.0) 272 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:28:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:40.871105+0000 mon.a (mon.0) 273 : cluster [INF] osd.2 [v2:172.21.15.5:6818/1278159410,v1:172.21.15.5:6819/1278159410] boot 2024-02-17T23:28:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:40.871145+0000 mon.a (mon.0) 274 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-17T23:28:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:40.872210+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:28:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:41.873033+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-17T23:28:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:40.719049+0000 mgr.y (mgr.44106) 139 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:28:40.719664+0000 mgr.y (mgr.44106) 140 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-02-17T23:28:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:40.808797+0000 mgr.y (mgr.44106) 141 : cluster [DBG] pgmap v82: 129 pgs: 10 active+undersized+degraded, 22 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 50/606 objects degraded (8.251%) 2024-02-17T23:28:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:40.867141+0000 mon.a (mon.0) 272 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:28:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:40.871105+0000 mon.a (mon.0) 273 : cluster [INF] osd.2 [v2:172.21.15.5:6818/1278159410,v1:172.21.15.5:6819/1278159410] boot 2024-02-17T23:28:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:40.871145+0000 mon.a (mon.0) 274 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-17T23:28:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:40.872210+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:28:42.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:41.873033+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-17T23:28:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:40.719049+0000 mgr.y (mgr.44106) 139 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:28:40.719664+0000 mgr.y (mgr.44106) 140 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (10 PGs are or would become offline) 2024-02-17T23:28:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:40.808797+0000 mgr.y (mgr.44106) 141 : cluster [DBG] pgmap v82: 129 pgs: 10 active+undersized+degraded, 22 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 50/606 objects degraded (8.251%) 2024-02-17T23:28:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:40.867141+0000 mon.a (mon.0) 272 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:28:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:40.871105+0000 mon.a (mon.0) 273 : cluster [INF] osd.2 [v2:172.21.15.5:6818/1278159410,v1:172.21.15.5:6819/1278159410] boot 2024-02-17T23:28:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:40.871145+0000 mon.a (mon.0) 274 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2024-02-17T23:28:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:40.872210+0000 mon.c (mon.1) 157 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-02-17T23:28:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:41.873033+0000 mon.a (mon.0) 275 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2024-02-17T23:28:44.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:42.809552+0000 mgr.y (mgr.44106) 142 : cluster [DBG] pgmap v85: 129 pgs: 7 peering, 7 active+undersized+degraded, 18 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 27/606 objects degraded (4.455%) 2024-02-17T23:28:44.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:42.809552+0000 mgr.y (mgr.44106) 142 : cluster [DBG] pgmap v85: 129 pgs: 7 peering, 7 active+undersized+degraded, 18 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 27/606 objects degraded (4.455%) 2024-02-17T23:28:44.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:42.809552+0000 mgr.y (mgr.44106) 142 : cluster [DBG] pgmap v85: 129 pgs: 7 peering, 7 active+undersized+degraded, 18 active+undersized, 97 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 27/606 objects degraded (4.455%) 2024-02-17T23:28:44.531 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:28:45.183 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:28:45.183 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (3m) 4s ago 9m 24.6M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:28:45.183 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (9m) 101s ago 9m 34.4M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:28:45.183 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (2m) 101s ago 13m 383M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:28:45.183 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (3m) 4s ago 14m 422M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:28:45.183 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (2m) 4s ago 15m 51.5M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:28:45.183 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (114s) 101s ago 13m 26.5M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:28:45.183 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (2m) 4s ago 13m 46.7M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:28:45.183 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (9m) 4s ago 9m 12.6M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:28:45.183 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (9m) 101s ago 9m 13.7M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (68s) 4s ago 12m 41.2M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (38s) 4s ago 12m 38.4M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (9s) 4s ago 12m 11.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 f9b5c6109867 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (11m) 4s ago 11m 46.5M 4096M 15.2.0 204a01f9b0b6 53d1e133da0b 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (11m) 101s ago 11m 45.1M 4096M 15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (10m) 101s ago 11m 41.9M 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (10m) 101s ago 10m 41.5M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (10m) 101s ago 10m 45.1M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (3m) 101s ago 9m 37.8M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (8m) 4s ago 8m 37.9M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:28:45.184 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (8m) 101s ago 8m 39.0M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:28:45.572 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:28:45.572 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:28:45.572 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:28:45.572 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 5, 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 7, 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 8 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:28:45.573 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:28:45.899 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:28:45.899 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:28:45.899 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:28:45.899 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:28:45.899 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:28:45.899 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:28:45.899 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-02-17T23:28:45.900 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:28:45.900 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "8/20 daemons upgraded", 2024-02-17T23:28:45.900 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-02-17T23:28:45.900 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:28:45.900 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:28:46.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:44.518026+0000 mgr.y (mgr.44106) 143 : audit [DBG] from='client.54211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:46.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:44.810287+0000 mgr.y (mgr.44106) 144 : cluster [DBG] pgmap v86: 129 pgs: 7 peering, 1 active+undersized+degraded, 9 active+undersized, 112 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 1/606 objects degraded (0.165%) 2024-02-17T23:28:46.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:44.847706+0000 mgr.y (mgr.44106) 145 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:46.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.170382+0000 mgr.y (mgr.44106) 146 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:46.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.172196+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.172562+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.172876+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.173225+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.173521+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.173817+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.175431+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.175741+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.176060+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.176372+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:44.518026+0000 mgr.y (mgr.44106) 143 : audit [DBG] from='client.54211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:46.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:44.810287+0000 mgr.y (mgr.44106) 144 : cluster [DBG] pgmap v86: 129 pgs: 7 peering, 1 active+undersized+degraded, 9 active+undersized, 112 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 1/606 objects degraded (0.165%) 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:44.847706+0000 mgr.y (mgr.44106) 145 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.170382+0000 mgr.y (mgr.44106) 146 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.172196+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.172562+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.172876+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.173225+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.173521+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.173817+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.175431+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.175741+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.176060+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.176372+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.176662+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.571185+0000 mon.c (mon.1) 169 : audit [DBG] from='client.44274 172.21.15.5:0/1695320174' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:46.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:45.725807+0000 mon.a (mon.0) 276 : cluster [WRN] Health check update: Degraded data redundancy: 1/606 objects degraded (0.165%), 1 pg degraded (PG_DEGRADED) 2024-02-17T23:28:46.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.176662+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.571185+0000 mon.c (mon.1) 169 : audit [DBG] from='client.44274 172.21.15.5:0/1695320174' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:46.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:45.725807+0000 mon.a (mon.0) 276 : cluster [WRN] Health check update: Degraded data redundancy: 1/606 objects degraded (0.165%), 1 pg degraded (PG_DEGRADED) 2024-02-17T23:28:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:44.518026+0000 mgr.y (mgr.44106) 143 : audit [DBG] from='client.54211 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:44.810287+0000 mgr.y (mgr.44106) 144 : cluster [DBG] pgmap v86: 129 pgs: 7 peering, 1 active+undersized+degraded, 9 active+undersized, 112 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 1/606 objects degraded (0.165%) 2024-02-17T23:28:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:44.847706+0000 mgr.y (mgr.44106) 145 : audit [DBG] from='client.54217 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.170382+0000 mgr.y (mgr.44106) 146 : audit [DBG] from='client.54223 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.172196+0000 mon.c (mon.1) 158 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.172562+0000 mon.c (mon.1) 159 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.172876+0000 mon.c (mon.1) 160 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.173225+0000 mon.c (mon.1) 161 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.173521+0000 mon.c (mon.1) 162 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.173817+0000 mon.c (mon.1) 163 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.175431+0000 mon.c (mon.1) 164 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:28:46.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.175741+0000 mon.c (mon.1) 165 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.176060+0000 mon.c (mon.1) 166 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.176372+0000 mon.c (mon.1) 167 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.176662+0000 mon.c (mon.1) 168 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:28:46.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.571185+0000 mon.c (mon.1) 169 : audit [DBG] from='client.44274 172.21.15.5:0/1695320174' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:28:46.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:45.725807+0000 mon.a (mon.0) 276 : cluster [WRN] Health check update: Degraded data redundancy: 1/606 objects degraded (0.165%), 1 pg degraded (PG_DEGRADED) 2024-02-17T23:28:47.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:45.897717+0000 mgr.y (mgr.44106) 147 : audit [DBG] from='client.44280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:47.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:45.897717+0000 mgr.y (mgr.44106) 147 : audit [DBG] from='client.44280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:47.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:45.897717+0000 mgr.y (mgr.44106) 147 : audit [DBG] from='client.44280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:28:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:46.810974+0000 mgr.y (mgr.44106) 148 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:46.898645+0000 mon.a (mon.0) 277 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/606 objects degraded (0.165%), 1 pg degraded) 2024-02-17T23:28:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:46.898677+0000 mon.a (mon.0) 278 : cluster [INF] Cluster is now healthy 2024-02-17T23:28:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:46.810974+0000 mgr.y (mgr.44106) 148 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:46.898645+0000 mon.a (mon.0) 277 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/606 objects degraded (0.165%), 1 pg degraded) 2024-02-17T23:28:48.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:46.898677+0000 mon.a (mon.0) 278 : cluster [INF] Cluster is now healthy 2024-02-17T23:28:48.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:46.810974+0000 mgr.y (mgr.44106) 148 : cluster [DBG] pgmap v87: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:48.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:46.898645+0000 mon.a (mon.0) 277 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1/606 objects degraded (0.165%), 1 pg degraded) 2024-02-17T23:28:48.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:46.898677+0000 mon.a (mon.0) 278 : cluster [INF] Cluster is now healthy 2024-02-17T23:28:50.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:48.811419+0000 mgr.y (mgr.44106) 149 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:50.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:48.811419+0000 mgr.y (mgr.44106) 149 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:50.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:49 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:48.811419+0000 mgr.y (mgr.44106) 149 : cluster [DBG] pgmap v88: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:52.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:51 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:50.812216+0000 mgr.y (mgr.44106) 150 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:52.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:51 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:50.812216+0000 mgr.y (mgr.44106) 150 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:52.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:50.812216+0000 mgr.y (mgr.44106) 150 : cluster [DBG] pgmap v89: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:54.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:52.812759+0000 mgr.y (mgr.44106) 151 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:54.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:52.812759+0000 mgr.y (mgr.44106) 151 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:54.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:52.812759+0000 mgr.y (mgr.44106) 151 : cluster [DBG] pgmap v90: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:55.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:54.041196+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:55.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:54.041196+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:55.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:54.041196+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:54.813428+0000 mgr.y (mgr.44106) 152 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:55.730298+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:56.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:54.813428+0000 mgr.y (mgr.44106) 152 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:56.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:55.730298+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:54.813428+0000 mgr.y (mgr.44106) 152 : cluster [DBG] pgmap v91: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:55.730298+0000 mon.c (mon.1) 170 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:57.254 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:55.730499+0000 mgr.y (mgr.44106) 153 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:57.254 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:28:55.731623+0000 mgr.y (mgr.44106) 154 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-02-17T23:28:57.255 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:55.730499+0000 mgr.y (mgr.44106) 153 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:57.255 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:28:55.731623+0000 mgr.y (mgr.44106) 154 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-02-17T23:28:57.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:55.730499+0000 mgr.y (mgr.44106) 153 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-02-17T23:28:57.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:28:55.731623+0000 mgr.y (mgr.44106) 154 : cephadm [INF] Upgrade: osd.3 is safe to restart 2024-02-17T23:28:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:56.813885+0000 mgr.y (mgr.44106) 155 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:57.279739+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:57.280708+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-17T23:28:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:57.281376+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:28:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:28:57.283002+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-17T23:28:58.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:56.813885+0000 mgr.y (mgr.44106) 155 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:57.279739+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:57.280708+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-17T23:28:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:57.281376+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:28:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:28:57.283002+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-17T23:28:58.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:56.813885+0000 mgr.y (mgr.44106) 155 : cluster [DBG] pgmap v92: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:28:58.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:57.279739+0000 mon.a (mon.0) 280 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:28:58.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:57.280708+0000 mon.c (mon.1) 171 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-02-17T23:28:58.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:57.281376+0000 mon.c (mon.1) 172 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:28:58.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:28:57.283002+0000 mon.c (mon.1) 173 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "container_image"}]: dispatch 2024-02-17T23:28:59.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:28:57.274938+0000 mgr.y (mgr.44106) 156 : cephadm [INF] Upgrade: Updating osd.3 2024-02-17T23:28:59.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:28:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:28:57.282586+0000 mgr.y (mgr.44106) 157 : cephadm [INF] Deploying daemon osd.3 on smithi005 2024-02-17T23:28:59.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:28:57.274938+0000 mgr.y (mgr.44106) 156 : cephadm [INF] Upgrade: Updating osd.3 2024-02-17T23:28:59.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:28:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:28:57.282586+0000 mgr.y (mgr.44106) 157 : cephadm [INF] Deploying daemon osd.3 on smithi005 2024-02-17T23:28:59.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:28:57.274938+0000 mgr.y (mgr.44106) 156 : cephadm [INF] Upgrade: Updating osd.3 2024-02-17T23:28:59.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:28:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:28:57.282586+0000 mgr.y (mgr.44106) 157 : cephadm [INF] Deploying daemon osd.3 on smithi005 2024-02-17T23:29:00.092 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:28:58.814206+0000 mgr.y (mgr.44106) 158 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:29:00.092 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:28:58.814206+0000 mgr.y (mgr.44106) 158 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:29:00.376 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:00 smithi005 systemd[1]: Stopping Ceph osd.3 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:29:00.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:28:58.814206+0000 mgr.y (mgr.44106) 158 : cluster [DBG] pgmap v93: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:29:00.699 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:00 smithi005 bash[45515]: debug 2024-02-17T23:29:00.396+0000 7f96b9a70700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:29:00.699 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:00 smithi005 bash[45515]: debug 2024-02-17T23:29:00.396+0000 7f96b9a70700 -1 osd.3 81 *** Got signal Terminated *** 2024-02-17T23:29:00.699 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:00 smithi005 bash[45515]: debug 2024-02-17T23:29:00.396+0000 7f96b9a70700 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:29:01.035 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:00 smithi005 bash[69086]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.3 2024-02-17T23:29:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.637269+0000 mon.a (mon.0) 281 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.637310+0000 mon.a (mon.0) 282 : cluster [INF] osd.3 failed (root=default,host=smithi005) (connection refused reported by osd.5) 2024-02-17T23:29:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.637544+0000 mon.a (mon.0) 283 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.637704+0000 mon.a (mon.0) 284 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.637803+0000 mon.a (mon.0) 285 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.637911+0000 mon.a (mon.0) 286 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.638010+0000 mon.a (mon.0) 287 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.638101+0000 mon.a (mon.0) 288 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.638179+0000 mon.a (mon.0) 289 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.638261+0000 mon.a (mon.0) 290 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.638363+0000 mon.a (mon.0) 291 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.638445+0000 mon.a (mon.0) 292 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.638532+0000 mon.a (mon.0) 293 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.638638+0000 mon.a (mon.0) 294 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.638761+0000 mon.a (mon.0) 295 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.038240+0000 mon.a (mon.0) 296 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.038337+0000 mon.a (mon.0) 297 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.038548+0000 mon.a (mon.0) 298 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.038637+0000 mon.a (mon.0) 299 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.038852+0000 mon.a (mon.0) 300 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.637269+0000 mon.a (mon.0) 281 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.637310+0000 mon.a (mon.0) 282 : cluster [INF] osd.3 failed (root=default,host=smithi005) (connection refused reported by osd.5) 2024-02-17T23:29:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.637544+0000 mon.a (mon.0) 283 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.637704+0000 mon.a (mon.0) 284 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.637803+0000 mon.a (mon.0) 285 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.637911+0000 mon.a (mon.0) 286 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.638010+0000 mon.a (mon.0) 287 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.638101+0000 mon.a (mon.0) 288 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.638179+0000 mon.a (mon.0) 289 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.638261+0000 mon.a (mon.0) 290 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.638363+0000 mon.a (mon.0) 291 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.638445+0000 mon.a (mon.0) 292 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.638532+0000 mon.a (mon.0) 293 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.638638+0000 mon.a (mon.0) 294 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.638761+0000 mon.a (mon.0) 295 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.038240+0000 mon.a (mon.0) 296 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.038337+0000 mon.a (mon.0) 297 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.038548+0000 mon.a (mon.0) 298 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.038637+0000 mon.a (mon.0) 299 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.038852+0000 mon.a (mon.0) 300 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.038991+0000 mon.a (mon.0) 301 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.039134+0000 mon.a (mon.0) 302 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.039283+0000 mon.a (mon.0) 303 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.039433+0000 mon.a (mon.0) 304 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.039632+0000 mon.a (mon.0) 305 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.039766+0000 mon.a (mon.0) 306 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.039942+0000 mon.a (mon.0) 307 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.040141+0000 mon.a (mon.0) 308 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.040237+0000 mon.a (mon.0) 309 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.038991+0000 mon.a (mon.0) 301 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.039134+0000 mon.a (mon.0) 302 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.039283+0000 mon.a (mon.0) 303 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.039433+0000 mon.a (mon.0) 304 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.039632+0000 mon.a (mon.0) 305 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.039766+0000 mon.a (mon.0) 306 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.039942+0000 mon.a (mon.0) 307 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.040141+0000 mon.a (mon.0) 308 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.040237+0000 mon.a (mon.0) 309 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.637269+0000 mon.a (mon.0) 281 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.637310+0000 mon.a (mon.0) 282 : cluster [INF] osd.3 failed (root=default,host=smithi005) (connection refused reported by osd.5) 2024-02-17T23:29:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.637544+0000 mon.a (mon.0) 283 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.637704+0000 mon.a (mon.0) 284 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.637803+0000 mon.a (mon.0) 285 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.637911+0000 mon.a (mon.0) 286 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.638010+0000 mon.a (mon.0) 287 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.638101+0000 mon.a (mon.0) 288 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.638179+0000 mon.a (mon.0) 289 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.638261+0000 mon.a (mon.0) 290 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.638363+0000 mon.a (mon.0) 291 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.638445+0000 mon.a (mon.0) 292 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.638532+0000 mon.a (mon.0) 293 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.638638+0000 mon.a (mon.0) 294 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.638761+0000 mon.a (mon.0) 295 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.038240+0000 mon.a (mon.0) 296 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.038337+0000 mon.a (mon.0) 297 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.038548+0000 mon.a (mon.0) 298 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.038637+0000 mon.a (mon.0) 299 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.038852+0000 mon.a (mon.0) 300 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.038991+0000 mon.a (mon.0) 301 : cluster [DBG] osd.3 reported immediately failed by osd.6 2024-02-17T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.039134+0000 mon.a (mon.0) 302 : cluster [DBG] osd.3 reported immediately failed by osd.7 2024-02-17T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.039283+0000 mon.a (mon.0) 303 : cluster [DBG] osd.3 reported immediately failed by osd.5 2024-02-17T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.039433+0000 mon.a (mon.0) 304 : cluster [DBG] osd.3 reported immediately failed by osd.1 2024-02-17T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.039632+0000 mon.a (mon.0) 305 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.039766+0000 mon.a (mon.0) 306 : cluster [DBG] osd.3 reported immediately failed by osd.4 2024-02-17T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.039942+0000 mon.a (mon.0) 307 : cluster [DBG] osd.3 reported immediately failed by osd.2 2024-02-17T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.040141+0000 mon.a (mon.0) 308 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.040237+0000 mon.a (mon.0) 309 : cluster [DBG] osd.3 reported immediately failed by osd.0 2024-02-17T23:29:02.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:00.814829+0000 mgr.y (mgr.44106) 159 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:29:02.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.057867+0000 mon.a (mon.0) 310 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:29:02.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:01.065840+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2024-02-17T23:29:02.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:00.814829+0000 mgr.y (mgr.44106) 159 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:29:02.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.057867+0000 mon.a (mon.0) 310 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:29:02.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:01.065840+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2024-02-17T23:29:02.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:00.814829+0000 mgr.y (mgr.44106) 159 : cluster [DBG] pgmap v94: 129 pgs: 129 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:29:02.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.057867+0000 mon.a (mon.0) 310 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:29:02.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:01.065840+0000 mon.a (mon.0) 311 : cluster [DBG] osdmap e82: 8 total, 7 up, 8 in 2024-02-17T23:29:03.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:02.068936+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2024-02-17T23:29:03.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:02.068936+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2024-02-17T23:29:03.378 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:02 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.3.service: Succeeded. 2024-02-17T23:29:03.378 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:02 smithi005 systemd[1]: Stopped Ceph osd.3 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:29:03.378 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:03 smithi005 systemd[1]: Starting Ceph osd.3 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:29:03.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:02.068936+0000 mon.a (mon.0) 312 : cluster [DBG] osdmap e83: 8 total, 7 up, 8 in 2024-02-17T23:29:04.247 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:02.815428+0000 mgr.y (mgr.44106) 160 : cluster [DBG] pgmap v97: 129 pgs: 23 peering, 10 stale+active+clean, 96 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:29:04.247 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:03.066176+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 4 pgs peering (PG_AVAILABILITY) 2024-02-17T23:29:04.247 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:02.815428+0000 mgr.y (mgr.44106) 160 : cluster [DBG] pgmap v97: 129 pgs: 23 peering, 10 stale+active+clean, 96 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:29:04.247 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:03.066176+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 4 pgs peering (PG_AVAILABILITY) 2024-02-17T23:29:04.248 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:03 smithi005 bash[69391]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-17T23:29:04.248 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:03 smithi005 bash[69391]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-17T23:29:04.248 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:03 smithi005 bash[69391]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-02-17T23:29:04.248 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:03 smithi005 bash[69391]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2024-02-17T23:29:04.248 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:03 smithi005 bash[69391]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-02-17T23:29:04.248 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:03 smithi005 bash[69391]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-17T23:29:04.248 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:03 smithi005 bash[69391]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-02-17T23:29:04.249 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:03 smithi005 bash[69391]: --> ceph-volume lvm activate successful for osd ID: 3 2024-02-17T23:29:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:02.815428+0000 mgr.y (mgr.44106) 160 : cluster [DBG] pgmap v97: 129 pgs: 23 peering, 10 stale+active+clean, 96 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail 2024-02-17T23:29:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:03.066176+0000 mon.a (mon.0) 313 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 4 pgs peering (PG_AVAILABILITY) 2024-02-17T23:29:05.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:05.072979+0000 mon.a (mon.0) 314 : cluster [WRN] Health check failed: Degraded data redundancy: 35/606 objects degraded (5.776%), 11 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:05.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:05.072979+0000 mon.a (mon.0) 314 : cluster [WRN] Health check failed: Degraded data redundancy: 35/606 objects degraded (5.776%), 11 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:05.376 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3[69671]: debug 2024-02-17T23:29:05.022+0000 7f16514cc700 1 -- 172.21.15.5:0/743932176 <== mon.0 v2:172.21.15.5:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x56187160c680 con 0x5618715d3000 2024-02-17T23:29:05.377 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:05 smithi005 bash[69657]: 050f8c4e76bc37d95c26451db2761e55a39f07329087da386c18ba43174dd819 2024-02-17T23:29:05.377 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:05 smithi005 systemd[1]: Started Ceph osd.3 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:29:05.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:05.072979+0000 mon.a (mon.0) 314 : cluster [WRN] Health check failed: Degraded data redundancy: 35/606 objects degraded (5.776%), 11 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:05.876 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3[69671]: debug 2024-02-17T23:29:05.542+0000 7f1658f5a380 -1 Falling back to public interface 2024-02-17T23:29:06.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:04.816073+0000 mgr.y (mgr.44106) 161 : cluster [DBG] pgmap v98: 129 pgs: 11 active+undersized+degraded, 23 peering, 1 stale+active+clean, 11 active+undersized, 83 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 35/606 objects degraded (5.776%) 2024-02-17T23:29:06.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:05.187821+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:06.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:05.188975+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:06.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:05.190291+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:29:06.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:04.816073+0000 mgr.y (mgr.44106) 161 : cluster [DBG] pgmap v98: 129 pgs: 11 active+undersized+degraded, 23 peering, 1 stale+active+clean, 11 active+undersized, 83 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 35/606 objects degraded (5.776%) 2024-02-17T23:29:06.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:05.187821+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:06.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:05.188975+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:06.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:05.190291+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:29:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:04.816073+0000 mgr.y (mgr.44106) 161 : cluster [DBG] pgmap v98: 129 pgs: 11 active+undersized+degraded, 23 peering, 1 stale+active+clean, 11 active+undersized, 83 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 35/606 objects degraded (5.776%) 2024-02-17T23:29:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:05.187821+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:05.188975+0000 mon.c (mon.1) 174 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:05.190291+0000 mon.c (mon.1) 175 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:29:07.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:06.816752+0000 mgr.y (mgr.44106) 162 : cluster [DBG] pgmap v99: 129 pgs: 24 active+undersized+degraded, 26 active+undersized, 79 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 78/606 objects degraded (12.871%) 2024-02-17T23:29:07.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:07.187986+0000 mon.a (mon.0) 316 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 4 pgs peering) 2024-02-17T23:29:07.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:06.816752+0000 mgr.y (mgr.44106) 162 : cluster [DBG] pgmap v99: 129 pgs: 24 active+undersized+degraded, 26 active+undersized, 79 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 78/606 objects degraded (12.871%) 2024-02-17T23:29:07.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:07.187986+0000 mon.a (mon.0) 316 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 4 pgs peering) 2024-02-17T23:29:07.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:06.816752+0000 mgr.y (mgr.44106) 162 : cluster [DBG] pgmap v99: 129 pgs: 24 active+undersized+degraded, 26 active+undersized, 79 active+clean; 7.0 KiB data, 878 MiB used, 709 GiB / 715 GiB avail; 78/606 objects degraded (12.871%) 2024-02-17T23:29:07.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:07.187986+0000 mon.a (mon.0) 316 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 4 pgs peering) 2024-02-17T23:29:08.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:08.301600+0000 mon.a (mon.0) 317 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-17T23:29:08.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:08.301600+0000 mon.a (mon.0) 317 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-17T23:29:08.626 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3[69671]: debug 2024-02-17T23:29:08.296+0000 7f1658f5a380 -1 osd.3 81 log_to_monitors {default=true} 2024-02-17T23:29:08.627 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:29:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3[69671]: debug 2024-02-17T23:29:08.423+0000 7f164bc44700 -1 osd.3 81 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T23:29:08.639 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:08.301600+0000 mon.a (mon.0) 317 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-02-17T23:29:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:08.356241+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-17T23:29:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:08.356312+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2024-02-17T23:29:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:08.366234+0000 mon.a (mon.0) 320 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:29:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:08.817255+0000 mgr.y (mgr.44106) 163 : cluster [DBG] pgmap v101: 129 pgs: 24 active+undersized+degraded, 26 active+undersized, 79 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 78/606 objects degraded (12.871%) 2024-02-17T23:29:09.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:08.356241+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-17T23:29:09.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:08.356312+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2024-02-17T23:29:09.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:08.366234+0000 mon.a (mon.0) 320 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:29:09.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:08.817255+0000 mgr.y (mgr.44106) 163 : cluster [DBG] pgmap v101: 129 pgs: 24 active+undersized+degraded, 26 active+undersized, 79 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 78/606 objects degraded (12.871%) 2024-02-17T23:29:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:08.356241+0000 mon.a (mon.0) 318 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-02-17T23:29:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:08.356312+0000 mon.a (mon.0) 319 : cluster [DBG] osdmap e84: 8 total, 7 up, 8 in 2024-02-17T23:29:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:08.366234+0000 mon.a (mon.0) 320 : audit [INF] from='osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi005", "root=default"]}]: dispatch 2024-02-17T23:29:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:08.817255+0000 mgr.y (mgr.44106) 163 : cluster [DBG] pgmap v101: 129 pgs: 24 active+undersized+degraded, 26 active+undersized, 79 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 78/606 objects degraded (12.871%) 2024-02-17T23:29:10.126 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:29:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:29:09.789+0000 7f36ce75d700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-17T23:29:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:09.368850+0000 mon.a (mon.0) 321 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:29:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:09.375394+0000 mon.a (mon.0) 322 : cluster [INF] osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789] boot 2024-02-17T23:29:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:09.375474+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-17T23:29:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:09.376622+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:29:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:09.480870+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:09.779867+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:09.784375+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:09.786695+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:09.787887+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:09.788796+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:09.789961+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:09.790112+0000 mgr.y (mgr.44106) 164 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:29:09.790776+0000 mgr.y (mgr.44106) 165 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:09.368850+0000 mon.a (mon.0) 321 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:09.375394+0000 mon.a (mon.0) 322 : cluster [INF] osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789] boot 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:09.375474+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:09.376622+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:09.480870+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:09.779867+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:09.784375+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:10.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:09.786695+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:10.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:09.787887+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:10.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:09.788796+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:10.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:09.789961+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:10.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:09.790112+0000 mgr.y (mgr.44106) 164 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:10.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:29:09.790776+0000 mgr.y (mgr.44106) 165 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-17T23:29:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:09.368850+0000 mon.a (mon.0) 321 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:29:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:09.375394+0000 mon.a (mon.0) 322 : cluster [INF] osd.3 [v2:172.21.15.5:6826/4207473789,v1:172.21.15.5:6827/4207473789] boot 2024-02-17T23:29:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:09.375474+0000 mon.a (mon.0) 323 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2024-02-17T23:29:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:09.376622+0000 mon.c (mon.1) 176 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-02-17T23:29:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:09.480870+0000 mon.a (mon.0) 324 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:09.779867+0000 mon.a (mon.0) 325 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:09.784375+0000 mon.c (mon.1) 177 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:09.786695+0000 mon.c (mon.1) 178 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:09.787887+0000 mon.c (mon.1) 179 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:09.788796+0000 mon.c (mon.1) 180 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:09.789961+0000 mon.c (mon.1) 181 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:09.790112+0000 mgr.y (mgr.44106) 164 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:10.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:29:09.790776+0000 mgr.y (mgr.44106) 165 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-17T23:29:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:10.382936+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-17T23:29:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:10.728963+0000 mon.a (mon.0) 327 : cluster [WRN] Health check update: Degraded data redundancy: 78/606 objects degraded (12.871%), 24 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:10.817760+0000 mgr.y (mgr.44106) 166 : cluster [DBG] pgmap v104: 129 pgs: 4 peering, 23 active+undersized+degraded, 23 active+undersized, 79 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 77/606 objects degraded (12.706%) 2024-02-17T23:29:11.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:10.382936+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-17T23:29:11.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:10.728963+0000 mon.a (mon.0) 327 : cluster [WRN] Health check update: Degraded data redundancy: 78/606 objects degraded (12.871%), 24 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:11.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:10.817760+0000 mgr.y (mgr.44106) 166 : cluster [DBG] pgmap v104: 129 pgs: 4 peering, 23 active+undersized+degraded, 23 active+undersized, 79 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 77/606 objects degraded (12.706%) 2024-02-17T23:29:11.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:10.382936+0000 mon.a (mon.0) 326 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2024-02-17T23:29:11.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:10.728963+0000 mon.a (mon.0) 327 : cluster [WRN] Health check update: Degraded data redundancy: 78/606 objects degraded (12.871%), 24 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:11.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:10.817760+0000 mgr.y (mgr.44106) 166 : cluster [DBG] pgmap v104: 129 pgs: 4 peering, 23 active+undersized+degraded, 23 active+undersized, 79 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 77/606 objects degraded (12.706%) 2024-02-17T23:29:14.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:12.818645+0000 mgr.y (mgr.44106) 167 : cluster [DBG] pgmap v105: 129 pgs: 4 peering, 15 active+undersized+degraded, 18 active+undersized, 92 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 51/606 objects degraded (8.416%) 2024-02-17T23:29:14.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:12.818645+0000 mgr.y (mgr.44106) 167 : cluster [DBG] pgmap v105: 129 pgs: 4 peering, 15 active+undersized+degraded, 18 active+undersized, 92 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 51/606 objects degraded (8.416%) 2024-02-17T23:29:14.139 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:12.818645+0000 mgr.y (mgr.44106) 167 : cluster [DBG] pgmap v105: 129 pgs: 4 peering, 15 active+undersized+degraded, 18 active+undersized, 92 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 51/606 objects degraded (8.416%) 2024-02-17T23:29:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:14.056168+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:15.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:14.056168+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:15.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:14.056168+0000 mon.a (mon.0) 328 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:16.260 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:29:16.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:14.819528+0000 mgr.y (mgr.44106) 168 : cluster [DBG] pgmap v106: 129 pgs: 4 peering, 125 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:16.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:15.054210+0000 mon.a (mon.0) 329 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/606 objects degraded (8.416%), 15 pgs degraded) 2024-02-17T23:29:16.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:15.054270+0000 mon.a (mon.0) 330 : cluster [INF] Cluster is now healthy 2024-02-17T23:29:16.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:14.819528+0000 mgr.y (mgr.44106) 168 : cluster [DBG] pgmap v106: 129 pgs: 4 peering, 125 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:16.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:15.054210+0000 mon.a (mon.0) 329 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/606 objects degraded (8.416%), 15 pgs degraded) 2024-02-17T23:29:16.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:15.054270+0000 mon.a (mon.0) 330 : cluster [INF] Cluster is now healthy 2024-02-17T23:29:16.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:14.819528+0000 mgr.y (mgr.44106) 168 : cluster [DBG] pgmap v106: 129 pgs: 4 peering, 125 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:16.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:15.054210+0000 mon.a (mon.0) 329 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 51/606 objects degraded (8.416%), 15 pgs degraded) 2024-02-17T23:29:16.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:15.054270+0000 mon.a (mon.0) 330 : cluster [INF] Cluster is now healthy 2024-02-17T23:29:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:29:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (4m) 7s ago 10m 24.6M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:29:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (9m) 2m ago 9m 34.4M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:29:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (3m) 2m ago 13m 383M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:29:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (3m) 7s ago 15m 423M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:29:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (3m) 7s ago 15m 54.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:29:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (2m) 2m ago 13m 26.5M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:29:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (2m) 7s ago 14m 49.8M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:29:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (10m) 7s ago 10m 12.6M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:29:16.906 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (10m) 2m ago 10m 13.7M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (100s) 7s ago 13m 41.2M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (70s) 7s ago 12m 39.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (41s) 7s ago 12m 36.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 f9b5c6109867 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (12s) 7s ago 12m 13.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 050f8c4e76bc 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (11m) 2m ago 11m 45.1M 4096M 15.2.0 204a01f9b0b6 e7700ac2ac98 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (11m) 2m ago 11m 41.9M 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (11m) 2m ago 11m 41.5M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (10m) 2m ago 10m 45.1M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (4m) 2m ago 10m 37.8M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (8m) 7s ago 8m 38.1M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:29:16.907 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (8m) 2m ago 8m 39.0M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:29:17.303 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 4, 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 4 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:29:17.304 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:29:17.305 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:29:17.305 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:29:17.305 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 6, 2024-02-17T23:29:17.305 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 9 2024-02-17T23:29:17.305 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:29:17.305 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:29:17.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.895141+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:17.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.895529+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:17.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.895831+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.896169+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.896490+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.896792+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.898449+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:17.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.898755+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.899049+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.899361+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.899644+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.895141+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:17.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.895529+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:17.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.895831+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.896169+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.896490+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.896792+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.898449+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:17.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.898755+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.899049+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.899361+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.899644+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.895141+0000 mon.c (mon.1) 182 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.895529+0000 mon.c (mon.1) 183 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.895831+0000 mon.c (mon.1) 184 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.896169+0000 mon.c (mon.1) 185 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.896490+0000 mon.c (mon.1) 186 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.896792+0000 mon.c (mon.1) 187 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.898449+0000 mon.c (mon.1) 188 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.898755+0000 mon.c (mon.1) 189 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.899049+0000 mon.c (mon.1) 190 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.899361+0000 mon.c (mon.1) 191 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.899644+0000 mon.c (mon.1) 192 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:17.630 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "9/20 daemons upgraded", 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:29:17.631 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:29:18.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.247277+0000 mgr.y (mgr.44106) 169 : audit [DBG] from='client.54247 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:18.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.575225+0000 mgr.y (mgr.44106) 170 : audit [DBG] from='client.54253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:18.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:16.820118+0000 mgr.y (mgr.44106) 171 : cluster [DBG] pgmap v107: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:18.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:16.893335+0000 mgr.y (mgr.44106) 172 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:18.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:17.302482+0000 mon.a (mon.0) 331 : audit [DBG] from='client.54265 172.21.15.5:0/3090306378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:18.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.247277+0000 mgr.y (mgr.44106) 169 : audit [DBG] from='client.54247 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:18.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.575225+0000 mgr.y (mgr.44106) 170 : audit [DBG] from='client.54253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:18.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:16.820118+0000 mgr.y (mgr.44106) 171 : cluster [DBG] pgmap v107: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:18.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:16.893335+0000 mgr.y (mgr.44106) 172 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:18.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:17.302482+0000 mon.a (mon.0) 331 : audit [DBG] from='client.54265 172.21.15.5:0/3090306378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:18.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.247277+0000 mgr.y (mgr.44106) 169 : audit [DBG] from='client.54247 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:18.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.575225+0000 mgr.y (mgr.44106) 170 : audit [DBG] from='client.54253 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:18.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:16.820118+0000 mgr.y (mgr.44106) 171 : cluster [DBG] pgmap v107: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:18.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:16.893335+0000 mgr.y (mgr.44106) 172 : audit [DBG] from='client.54259 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:18.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:17.302482+0000 mon.a (mon.0) 331 : audit [DBG] from='client.54265 172.21.15.5:0/3090306378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:19.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:17.629132+0000 mgr.y (mgr.44106) 173 : audit [DBG] from='client.54271 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:19.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:17.629132+0000 mgr.y (mgr.44106) 173 : audit [DBG] from='client.54271 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:19.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:17.629132+0000 mgr.y (mgr.44106) 173 : audit [DBG] from='client.54271 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:20.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:18.820593+0000 mgr.y (mgr.44106) 174 : cluster [DBG] pgmap v108: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:20.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:18.820593+0000 mgr.y (mgr.44106) 174 : cluster [DBG] pgmap v108: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:20.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:18.820593+0000 mgr.y (mgr.44106) 174 : cluster [DBG] pgmap v108: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:22.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:20.821231+0000 mgr.y (mgr.44106) 175 : cluster [DBG] pgmap v109: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:22.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:20.821231+0000 mgr.y (mgr.44106) 175 : cluster [DBG] pgmap v109: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:22.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:20.821231+0000 mgr.y (mgr.44106) 175 : cluster [DBG] pgmap v109: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:22.821731+0000 mgr.y (mgr.44106) 176 : cluster [DBG] pgmap v110: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:24.069602+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:24.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:22.821731+0000 mgr.y (mgr.44106) 176 : cluster [DBG] pgmap v110: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:24.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:24.069602+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:24.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:22.821731+0000 mgr.y (mgr.44106) 176 : cluster [DBG] pgmap v110: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:24.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:24.069602+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:25.340 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:24.801818+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:25.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:24.801818+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:25.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:24.801818+0000 mon.c (mon.1) 193 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:24.802024+0000 mgr.y (mgr.44106) 177 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:29:24.803179+0000 mgr.y (mgr.44106) 178 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-02-17T23:29:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:24.822496+0000 mgr.y (mgr.44106) 179 : cluster [DBG] pgmap v111: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:26.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:24.802024+0000 mgr.y (mgr.44106) 177 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:26.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:29:24.803179+0000 mgr.y (mgr.44106) 178 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-02-17T23:29:26.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:24.822496+0000 mgr.y (mgr.44106) 179 : cluster [DBG] pgmap v111: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:24.802024+0000 mgr.y (mgr.44106) 177 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-02-17T23:29:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:29:24.803179+0000 mgr.y (mgr.44106) 178 : cephadm [INF] Upgrade: osd.4 is safe to restart 2024-02-17T23:29:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:24.822496+0000 mgr.y (mgr.44106) 179 : cluster [DBG] pgmap v111: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:27.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:29:26.507309+0000 mgr.y (mgr.44106) 180 : cephadm [INF] Upgrade: Updating osd.4 2024-02-17T23:29:27.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:26.512537+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:27.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:26.513881+0000 mon.c (mon.1) 194 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-17T23:29:27.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:26.514684+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:29:27.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:29:26.516022+0000 mgr.y (mgr.44106) 181 : cephadm [INF] Deploying daemon osd.4 on smithi080 2024-02-17T23:29:27.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:26.516532+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-17T23:29:27.877 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:26.823228+0000 mgr.y (mgr.44106) 182 : cluster [DBG] pgmap v112: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:27.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:29:26.507309+0000 mgr.y (mgr.44106) 180 : cephadm [INF] Upgrade: Updating osd.4 2024-02-17T23:29:27.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:26.512537+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:27.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:26.513881+0000 mon.c (mon.1) 194 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-17T23:29:27.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:26.514684+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:29:27.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:29:26.516022+0000 mgr.y (mgr.44106) 181 : cephadm [INF] Deploying daemon osd.4 on smithi080 2024-02-17T23:29:27.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:26.516532+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-17T23:29:27.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:26.823228+0000 mgr.y (mgr.44106) 182 : cluster [DBG] pgmap v112: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:29:26.507309+0000 mgr.y (mgr.44106) 180 : cephadm [INF] Upgrade: Updating osd.4 2024-02-17T23:29:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:26.512537+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:26.513881+0000 mon.c (mon.1) 194 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-02-17T23:29:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:26.514684+0000 mon.c (mon.1) 195 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:29:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:29:26.516022+0000 mgr.y (mgr.44106) 181 : cephadm [INF] Deploying daemon osd.4 on smithi080 2024-02-17T23:29:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:26.516532+0000 mon.c (mon.1) 196 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "container_image"}]: dispatch 2024-02-17T23:29:27.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:26.823228+0000 mgr.y (mgr.44106) 182 : cluster [DBG] pgmap v112: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:28.988 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:28.821507+0000 mon.c (mon.1) 197 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-17T23:29:28.991 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:28.821803+0000 mon.c (mon.1) 198 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:29:28.991 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:28.821951+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-17T23:29:28.991 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:28.822054+0000 mon.c (mon.1) 199 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2024-02-17T23:29:28.992 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:28.822298+0000 mon.c (mon.1) 200 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:29:28.992 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:28.822649+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:29:28.992 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:28.823072+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2024-02-17T23:29:28.992 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:28.823328+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:29:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:28.821507+0000 mon.c (mon.1) 197 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-17T23:29:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:28.821803+0000 mon.c (mon.1) 198 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:29:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:28.821951+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-17T23:29:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:28.822054+0000 mon.c (mon.1) 199 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2024-02-17T23:29:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:28.822298+0000 mon.c (mon.1) 200 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:29:29.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:28.822649+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:29:29.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:28.823072+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2024-02-17T23:29:29.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:28.823328+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:29:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:28.821507+0000 mon.c (mon.1) 197 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-17T23:29:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:28.821803+0000 mon.c (mon.1) 198 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:29:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:28.821951+0000 mon.a (mon.0) 334 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2024-02-17T23:29:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:28.822054+0000 mon.c (mon.1) 199 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2024-02-17T23:29:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:28.822298+0000 mon.c (mon.1) 200 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:29:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:28.822649+0000 mon.a (mon.0) 335 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-02-17T23:29:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:28.823072+0000 mon.a (mon.0) 336 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2024-02-17T23:29:29.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:28.823328+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:29:29.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:29 smithi080 systemd[1]: Stopping Ceph osd.4 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:29:30.007 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:29 smithi080 bash[37749]: debug 2024-02-17T23:29:29.641+0000 7ff80709e700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:29:30.007 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:29 smithi080 bash[37749]: debug 2024-02-17T23:29:29.641+0000 7ff80709e700 -1 osd.4 86 *** Got signal Terminated *** 2024-02-17T23:29:30.007 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:29 smithi080 bash[37749]: debug 2024-02-17T23:29:29.641+0000 7ff80709e700 -1 osd.4 86 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:29:30.008 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:28.823690+0000 mgr.y (mgr.44106) 183 : cluster [DBG] pgmap v113: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:30.008 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:29.696221+0000 mon.a (mon.0) 338 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-17T23:29:30.008 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:29.696269+0000 mon.a (mon.0) 339 : cluster [INF] osd.4 failed (root=default,host=smithi080) (connection refused reported by osd.3) 2024-02-17T23:29:30.008 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:29.696481+0000 mon.a (mon.0) 340 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-17T23:29:30.008 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:29.696627+0000 mon.a (mon.0) 341 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-17T23:29:30.009 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:29.696795+0000 mon.a (mon.0) 342 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-17T23:29:30.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:28.823690+0000 mgr.y (mgr.44106) 183 : cluster [DBG] pgmap v113: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:30.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:29.696221+0000 mon.a (mon.0) 338 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-17T23:29:30.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:29.696269+0000 mon.a (mon.0) 339 : cluster [INF] osd.4 failed (root=default,host=smithi080) (connection refused reported by osd.3) 2024-02-17T23:29:30.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:29.696481+0000 mon.a (mon.0) 340 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-17T23:29:30.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:29.696627+0000 mon.a (mon.0) 341 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-17T23:29:30.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:29.696795+0000 mon.a (mon.0) 342 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-17T23:29:30.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:28.823690+0000 mgr.y (mgr.44106) 183 : cluster [DBG] pgmap v113: 129 pgs: 129 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:30.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:29.696221+0000 mon.a (mon.0) 338 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-17T23:29:30.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:29.696269+0000 mon.a (mon.0) 339 : cluster [INF] osd.4 failed (root=default,host=smithi080) (connection refused reported by osd.3) 2024-02-17T23:29:30.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:29.696481+0000 mon.a (mon.0) 340 : cluster [DBG] osd.4 reported immediately failed by osd.3 2024-02-17T23:29:30.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:29.696627+0000 mon.a (mon.0) 341 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-17T23:29:30.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:29.696795+0000 mon.a (mon.0) 342 : cluster [DBG] osd.4 reported immediately failed by osd.2 2024-02-17T23:29:30.389 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:30 smithi080 bash[56472]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.4 2024-02-17T23:29:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:30 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:29.884534+0000 mon.a (mon.0) 343 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:29:31.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:30 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:29.893990+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2024-02-17T23:29:31.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:29.884534+0000 mon.a (mon.0) 343 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:29:31.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:29.893990+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2024-02-17T23:29:31.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:29.884534+0000 mon.a (mon.0) 343 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:29:31.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:29.893990+0000 mon.a (mon.0) 344 : cluster [DBG] osdmap e87: 8 total, 7 up, 8 in 2024-02-17T23:29:31.982 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:30.824170+0000 mgr.y (mgr.44106) 184 : cluster [DBG] pgmap v115: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:31.982 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:30.898724+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2024-02-17T23:29:32.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:30.824170+0000 mgr.y (mgr.44106) 184 : cluster [DBG] pgmap v115: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:32.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:30.898724+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2024-02-17T23:29:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:30.824170+0000 mgr.y (mgr.44106) 184 : cluster [DBG] pgmap v115: 129 pgs: 18 stale+active+clean, 111 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail 2024-02-17T23:29:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:30.898724+0000 mon.a (mon.0) 345 : cluster [DBG] osdmap e88: 8 total, 7 up, 8 in 2024-02-17T23:29:32.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:32 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.4.service: Succeeded. 2024-02-17T23:29:32.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:32 smithi080 systemd[1]: Stopped Ceph osd.4 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:29:32.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:32 smithi080 systemd[1]: Starting Ceph osd.4 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:29:33.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:32.897909+0000 mon.a (mon.0) 346 : cluster [WRN] Health check failed: Degraded data redundancy: 39/606 objects degraded (6.436%), 11 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:32.897909+0000 mon.a (mon.0) 346 : cluster [WRN] Health check failed: Degraded data redundancy: 39/606 objects degraded (6.436%), 11 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:33.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:32.897909+0000 mon.a (mon.0) 346 : cluster [WRN] Health check failed: Degraded data redundancy: 39/606 objects degraded (6.436%), 11 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:33.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:33 smithi080 bash[56779]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-17T23:29:33.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:33 smithi080 bash[56779]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-17T23:29:33.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:33 smithi080 bash[56779]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-02-17T23:29:33.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:33 smithi080 bash[56779]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2024-02-17T23:29:33.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:33 smithi080 bash[56779]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-02-17T23:29:33.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:33 smithi080 bash[56779]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-02-17T23:29:33.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:33 smithi080 bash[56779]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-02-17T23:29:33.640 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:33 smithi080 bash[56779]: --> ceph-volume lvm activate successful for osd ID: 4 2024-02-17T23:29:34.328 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:32.824937+0000 mgr.y (mgr.44106) 185 : cluster [DBG] pgmap v117: 129 pgs: 11 active+undersized+degraded, 14 stale+active+clean, 7 active+undersized, 97 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 39/606 objects degraded (6.436%) 2024-02-17T23:29:34.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:32.824937+0000 mgr.y (mgr.44106) 185 : cluster [DBG] pgmap v117: 129 pgs: 11 active+undersized+degraded, 14 stale+active+clean, 7 active+undersized, 97 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 39/606 objects degraded (6.436%) 2024-02-17T23:29:34.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:32.824937+0000 mgr.y (mgr.44106) 185 : cluster [DBG] pgmap v117: 129 pgs: 11 active+undersized+degraded, 14 stale+active+clean, 7 active+undersized, 97 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 39/606 objects degraded (6.436%) 2024-02-17T23:29:34.578 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:29:34.462+0000 7effb1ba5700 1 -- 172.21.15.80:0/69739170 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55d99392e680 con 0x55d9938f5000 2024-02-17T23:29:34.578 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:34 smithi080 bash[57055]: e57f1f31914354efddaf5a0ce43f3dd6128aefaae0d2269eda93d45836bd0a24 2024-02-17T23:29:34.578 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:34 smithi080 systemd[1]: Started Ceph osd.4 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:29:35.390 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:29:34.993+0000 7effb9633380 -1 Falling back to public interface 2024-02-17T23:29:35.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:34.622619+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:35.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:34.624179+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:35.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:34.626155+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:29:35.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:34.825674+0000 mgr.y (mgr.44106) 186 : cluster [DBG] pgmap v118: 129 pgs: 24 active+undersized+degraded, 2 stale+active+clean, 29 active+undersized, 74 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 99/606 objects degraded (16.337%) 2024-02-17T23:29:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:34.622619+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:34.624179+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:34.626155+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:29:36.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:34.825674+0000 mgr.y (mgr.44106) 186 : cluster [DBG] pgmap v118: 129 pgs: 24 active+undersized+degraded, 2 stale+active+clean, 29 active+undersized, 74 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 99/606 objects degraded (16.337%) 2024-02-17T23:29:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:34.622619+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:36.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:34.624179+0000 mon.c (mon.1) 201 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:36.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:34.626155+0000 mon.c (mon.1) 202 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:29:36.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:34.825674+0000 mgr.y (mgr.44106) 186 : cluster [DBG] pgmap v118: 129 pgs: 24 active+undersized+degraded, 2 stale+active+clean, 29 active+undersized, 74 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 99/606 objects degraded (16.337%) 2024-02-17T23:29:37.887 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:29:37.720+0000 7effb9633380 -1 osd.4 86 log_to_monitors {default=true} 2024-02-17T23:29:38.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:29:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:29:37.907+0000 7effaa319700 -1 osd.4 86 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T23:29:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:36.826399+0000 mgr.y (mgr.44106) 187 : cluster [DBG] pgmap v119: 129 pgs: 26 active+undersized+degraded, 30 active+undersized, 73 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 105/606 objects degraded (17.327%) 2024-02-17T23:29:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:37.723946+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/2881957251,v1:172.21.15.80:6801/2881957251]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:29:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:37.724368+0000 mon.a (mon.0) 348 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:29:38.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:36.826399+0000 mgr.y (mgr.44106) 187 : cluster [DBG] pgmap v119: 129 pgs: 26 active+undersized+degraded, 30 active+undersized, 73 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 105/606 objects degraded (17.327%) 2024-02-17T23:29:38.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:37.723946+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/2881957251,v1:172.21.15.80:6801/2881957251]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:29:38.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:37.724368+0000 mon.a (mon.0) 348 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:29:38.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:36.826399+0000 mgr.y (mgr.44106) 187 : cluster [DBG] pgmap v119: 129 pgs: 26 active+undersized+degraded, 30 active+undersized, 73 active+clean; 7.0 KiB data, 1.1 GiB used, 710 GiB / 715 GiB avail; 105/606 objects degraded (17.327%) 2024-02-17T23:29:38.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:37.723946+0000 mon.b (mon.2) 3 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/2881957251,v1:172.21.15.80:6801/2881957251]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:29:38.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:37.724368+0000 mon.a (mon.0) 348 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-02-17T23:29:39.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:37.883692+0000 mon.a (mon.0) 349 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-17T23:29:39.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:37.883775+0000 mon.a (mon.0) 350 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2024-02-17T23:29:39.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:37.884305+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/2881957251,v1:172.21.15.80:6801/2881957251]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:29:39.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:37.884754+0000 mon.a (mon.0) 351 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:29:39.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:37.883692+0000 mon.a (mon.0) 349 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-17T23:29:39.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:37.883775+0000 mon.a (mon.0) 350 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2024-02-17T23:29:39.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:37.884305+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/2881957251,v1:172.21.15.80:6801/2881957251]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:29:39.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:37.884754+0000 mon.a (mon.0) 351 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:29:39.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:37.883692+0000 mon.a (mon.0) 349 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-02-17T23:29:39.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:37.883775+0000 mon.a (mon.0) 350 : cluster [DBG] osdmap e89: 8 total, 7 up, 8 in 2024-02-17T23:29:39.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:37.884305+0000 mon.b (mon.2) 4 : audit [INF] from='osd.4 [v2:172.21.15.80:6800/2881957251,v1:172.21.15.80:6801/2881957251]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:29:39.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:37.884754+0000 mon.a (mon.0) 351 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:29:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:38.826904+0000 mgr.y (mgr.44106) 188 : cluster [DBG] pgmap v121: 129 pgs: 26 active+undersized+degraded, 30 active+undersized, 73 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 105/606 objects degraded (17.327%) 2024-02-17T23:29:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:38.886357+0000 mon.a (mon.0) 352 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:29:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:38.892929+0000 mon.a (mon.0) 353 : cluster [INF] osd.4 [v2:172.21.15.80:6800/2881957251,v1:172.21.15.80:6801/2881957251] boot 2024-02-17T23:29:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:38.892978+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-17T23:29:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:38.893976+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:29:40.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:38.826904+0000 mgr.y (mgr.44106) 188 : cluster [DBG] pgmap v121: 129 pgs: 26 active+undersized+degraded, 30 active+undersized, 73 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 105/606 objects degraded (17.327%) 2024-02-17T23:29:40.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:38.886357+0000 mon.a (mon.0) 352 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:29:40.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:38.892929+0000 mon.a (mon.0) 353 : cluster [INF] osd.4 [v2:172.21.15.80:6800/2881957251,v1:172.21.15.80:6801/2881957251] boot 2024-02-17T23:29:40.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:38.892978+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-17T23:29:40.212 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:38.893976+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:29:40.213 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:38.826904+0000 mgr.y (mgr.44106) 188 : cluster [DBG] pgmap v121: 129 pgs: 26 active+undersized+degraded, 30 active+undersized, 73 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 105/606 objects degraded (17.327%) 2024-02-17T23:29:40.213 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:38.886357+0000 mon.a (mon.0) 352 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:29:40.213 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:38.892929+0000 mon.a (mon.0) 353 : cluster [INF] osd.4 [v2:172.21.15.80:6800/2881957251,v1:172.21.15.80:6801/2881957251] boot 2024-02-17T23:29:40.213 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:38.892978+0000 mon.a (mon.0) 354 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2024-02-17T23:29:40.213 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:38.893976+0000 mon.c (mon.1) 203 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-02-17T23:29:40.626 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:29:40.209+0000 7f36ce75d700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-17T23:29:41.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:39.895222+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-17T23:29:41.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:40.192146+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:41.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:40.197739+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:41.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:40.203576+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:41.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:40.206614+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:41.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:40.208123+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:41.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:40.209303+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:41.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:40.210791+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:41.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:40.210949+0000 mgr.y (mgr.44106) 189 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:41.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:29:40.212146+0000 mgr.y (mgr.44106) 190 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-17T23:29:41.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:40.733575+0000 mon.a (mon.0) 358 : cluster [WRN] Health check update: Degraded data redundancy: 105/606 objects degraded (17.327%), 26 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:39.895222+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-17T23:29:41.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:40.192146+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:41.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:40.197739+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:41.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:40.203576+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:41.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:40.206614+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:41.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:40.208123+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:41.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:40.209303+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:41.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:40.210791+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:41.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:40.210949+0000 mgr.y (mgr.44106) 189 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:41.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:29:40.212146+0000 mgr.y (mgr.44106) 190 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-17T23:29:41.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:40.733575+0000 mon.a (mon.0) 358 : cluster [WRN] Health check update: Degraded data redundancy: 105/606 objects degraded (17.327%), 26 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:39.895222+0000 mon.a (mon.0) 355 : cluster [DBG] osdmap e91: 8 total, 8 up, 8 in 2024-02-17T23:29:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:40.192146+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:40.197739+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:40.203576+0000 mon.c (mon.1) 204 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:29:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:40.206614+0000 mon.c (mon.1) 205 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:40.208123+0000 mon.c (mon.1) 206 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:40.209303+0000 mon.c (mon.1) 207 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:40.210791+0000 mon.c (mon.1) 208 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:40.210949+0000 mgr.y (mgr.44106) 189 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:29:40.212146+0000 mgr.y (mgr.44106) 190 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (8 PGs are or would become offline) 2024-02-17T23:29:41.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:40.733575+0000 mon.a (mon.0) 358 : cluster [WRN] Health check update: Degraded data redundancy: 105/606 objects degraded (17.327%), 26 pgs degraded (PG_DEGRADED) 2024-02-17T23:29:42.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:40.827616+0000 mgr.y (mgr.44106) 191 : cluster [DBG] pgmap v124: 129 pgs: 1 peering, 26 active+undersized+degraded, 29 active+undersized, 73 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 105/606 objects degraded (17.327%) 2024-02-17T23:29:42.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:40.827616+0000 mgr.y (mgr.44106) 191 : cluster [DBG] pgmap v124: 129 pgs: 1 peering, 26 active+undersized+degraded, 29 active+undersized, 73 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 105/606 objects degraded (17.327%) 2024-02-17T23:29:42.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:40.827616+0000 mgr.y (mgr.44106) 191 : cluster [DBG] pgmap v124: 129 pgs: 1 peering, 26 active+undersized+degraded, 29 active+undersized, 73 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 105/606 objects degraded (17.327%) 2024-02-17T23:29:44.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:44 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:42.828346+0000 mgr.y (mgr.44106) 192 : cluster [DBG] pgmap v125: 129 pgs: 1 peering, 19 active+undersized+degraded, 22 active+undersized, 87 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:29:44.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:44 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:42.828346+0000 mgr.y (mgr.44106) 192 : cluster [DBG] pgmap v125: 129 pgs: 1 peering, 19 active+undersized+degraded, 22 active+undersized, 87 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:29:44.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:44 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:42.828346+0000 mgr.y (mgr.44106) 192 : cluster [DBG] pgmap v125: 129 pgs: 1 peering, 19 active+undersized+degraded, 22 active+undersized, 87 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:29:45.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:44.828932+0000 mgr.y (mgr.44106) 193 : cluster [DBG] pgmap v126: 129 pgs: 1 peering, 128 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:45.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:45.202407+0000 mon.a (mon.0) 359 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 80/606 objects degraded (13.201%), 19 pgs degraded) 2024-02-17T23:29:45.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:45.202461+0000 mon.a (mon.0) 360 : cluster [INF] Cluster is now healthy 2024-02-17T23:29:45.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:44.828932+0000 mgr.y (mgr.44106) 193 : cluster [DBG] pgmap v126: 129 pgs: 1 peering, 128 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:45.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:45.202407+0000 mon.a (mon.0) 359 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 80/606 objects degraded (13.201%), 19 pgs degraded) 2024-02-17T23:29:45.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:45.202461+0000 mon.a (mon.0) 360 : cluster [INF] Cluster is now healthy 2024-02-17T23:29:45.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:44.828932+0000 mgr.y (mgr.44106) 193 : cluster [DBG] pgmap v126: 129 pgs: 1 peering, 128 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:45.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:45.202407+0000 mon.a (mon.0) 359 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 80/606 objects degraded (13.201%), 19 pgs degraded) 2024-02-17T23:29:45.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:45.202461+0000 mon.a (mon.0) 360 : cluster [INF] Cluster is now healthy 2024-02-17T23:29:47.987 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:29:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:46.829414+0000 mgr.y (mgr.44106) 194 : cluster [DBG] pgmap v127: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:46.829414+0000 mgr.y (mgr.44106) 194 : cluster [DBG] pgmap v127: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:48.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:46.829414+0000 mgr.y (mgr.44106) 194 : cluster [DBG] pgmap v127: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:48.631 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:29:48.631 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (4m) 39s ago 10m 24.6M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:29:48.631 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (10m) 8s ago 10m 34.5M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (3m) 8s ago 14m 384M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (4m) 39s ago 15m 423M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (3m) 39s ago 16m 54.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (2m) 8s ago 14m 51.3M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (3m) 39s ago 14m 49.8M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (10m) 39s ago 10m 12.6M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (10m) 8s ago 10m 14.3M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (2m) 39s ago 13m 41.2M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (102s) 39s ago 13m 39.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (72s) 39s ago 13m 36.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 f9b5c6109867 2024-02-17T23:29:48.632 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (43s) 39s ago 12m 13.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 050f8c4e76bc 2024-02-17T23:29:48.633 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (14s) 8s ago 12m 11.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 e57f1f319143 2024-02-17T23:29:48.633 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (11m) 8s ago 12m 44.9M 4096M 15.2.0 204a01f9b0b6 6d47425e8cfa 2024-02-17T23:29:48.633 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (11m) 8s ago 11m 45.0M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:29:48.633 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (11m) 8s ago 11m 48.9M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:29:48.633 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (4m) 8s ago 10m 43.3M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:29:48.633 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (9m) 39s ago 9m 38.1M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:29:48.633 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (9m) 8s ago 9m 39.8M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:29:49.026 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:29:49.026 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:29:49.026 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:29:49.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:29:49.026 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:29:49.026 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:29:49.026 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:29:49.026 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:29:49.026 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 5 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 5, 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 10 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:29:49.027 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:29:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:47.974802+0000 mgr.y (mgr.44106) 195 : audit [DBG] from='client.54277 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.620257+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.620655+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.620981+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.621304+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.621612+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.621922+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.623572+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.623913+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.624237+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.624541+0000 mon.c (mon.1) 218 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.624841+0000 mon.c (mon.1) 219 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.354 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:29:49.354 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:29:49.354 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:29:49.355 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:29:49.355 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:29:49.355 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:29:49.355 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-02-17T23:29:49.355 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:29:49.355 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "10/20 daemons upgraded", 2024-02-17T23:29:49.355 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-02-17T23:29:49.355 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:29:49.355 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:29:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:47.974802+0000 mgr.y (mgr.44106) 195 : audit [DBG] from='client.54277 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.620257+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.620655+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.620981+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.621304+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.621612+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.621922+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.623572+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.623913+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.624237+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.624541+0000 mon.c (mon.1) 218 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.624841+0000 mon.c (mon.1) 219 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:47.974802+0000 mgr.y (mgr.44106) 195 : audit [DBG] from='client.54277 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.620257+0000 mon.c (mon.1) 209 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.620655+0000 mon.c (mon.1) 210 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.620981+0000 mon.c (mon.1) 211 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.621304+0000 mon.c (mon.1) 212 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.621612+0000 mon.c (mon.1) 213 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.621922+0000 mon.c (mon.1) 214 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.623572+0000 mon.c (mon.1) 215 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.623913+0000 mon.c (mon.1) 216 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.624237+0000 mon.c (mon.1) 217 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.624541+0000 mon.c (mon.1) 218 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:49.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.624841+0000 mon.c (mon.1) 219 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:29:50.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.301012+0000 mgr.y (mgr.44106) 196 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:50.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:48.618465+0000 mgr.y (mgr.44106) 197 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:50.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:48.829848+0000 mgr.y (mgr.44106) 198 : cluster [DBG] pgmap v128: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:50.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:49.024802+0000 mon.a (mon.0) 361 : audit [DBG] from='client.44340 172.21.15.5:0/3038875995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:50.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.301012+0000 mgr.y (mgr.44106) 196 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:50.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:48.618465+0000 mgr.y (mgr.44106) 197 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:50.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:48.829848+0000 mgr.y (mgr.44106) 198 : cluster [DBG] pgmap v128: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:50.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:49.024802+0000 mon.a (mon.0) 361 : audit [DBG] from='client.44340 172.21.15.5:0/3038875995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:50.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:49 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.301012+0000 mgr.y (mgr.44106) 196 : audit [DBG] from='client.44328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:50.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:49 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:48.618465+0000 mgr.y (mgr.44106) 197 : audit [DBG] from='client.44334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:50.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:49 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:48.829848+0000 mgr.y (mgr.44106) 198 : cluster [DBG] pgmap v128: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:50.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:49 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:49.024802+0000 mon.a (mon.0) 361 : audit [DBG] from='client.44340 172.21.15.5:0/3038875995' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:29:51.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:50 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:49.352940+0000 mgr.y (mgr.44106) 199 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:51.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:50 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:49.352940+0000 mgr.y (mgr.44106) 199 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:51.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:50 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:49.352940+0000 mgr.y (mgr.44106) 199 : audit [DBG] from='client.44346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:29:52.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:51 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:50.830446+0000 mgr.y (mgr.44106) 200 : cluster [DBG] pgmap v129: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:52.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:51 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:50.830446+0000 mgr.y (mgr.44106) 200 : cluster [DBG] pgmap v129: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:52.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:50.830446+0000 mgr.y (mgr.44106) 200 : cluster [DBG] pgmap v129: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:54.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:52.831121+0000 mgr.y (mgr.44106) 201 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:54.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:52.831121+0000 mgr.y (mgr.44106) 201 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:54.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:52.831121+0000 mgr.y (mgr.44106) 201 : cluster [DBG] pgmap v130: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:55.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:54.089671+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:55.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:54.089671+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:55.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:54.089671+0000 mon.a (mon.0) 362 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:54.831713+0000 mgr.y (mgr.44106) 202 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:55.225644+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:55.225854+0000 mgr.y (mgr.44106) 203 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:29:55.226999+0000 mgr.y (mgr.44106) 204 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-02-17T23:29:56.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:54.831713+0000 mgr.y (mgr.44106) 202 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:56.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:55.225644+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:56.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:55.225854+0000 mgr.y (mgr.44106) 203 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:56.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:29:55.226999+0000 mgr.y (mgr.44106) 204 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-02-17T23:29:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:54.831713+0000 mgr.y (mgr.44106) 202 : cluster [DBG] pgmap v131: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:55.225644+0000 mon.c (mon.1) 220 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:55.225854+0000 mgr.y (mgr.44106) 203 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-02-17T23:29:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:29:55.226999+0000 mgr.y (mgr.44106) 204 : cephadm [INF] Upgrade: osd.5 is safe to restart 2024-02-17T23:29:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:29:56.788485+0000 mgr.y (mgr.44106) 205 : cephadm [INF] Upgrade: Updating osd.5 2024-02-17T23:29:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:56.793872+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:56.794954+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:29:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:56.795741+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:29:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:29:56.797136+0000 mgr.y (mgr.44106) 206 : cephadm [INF] Deploying daemon osd.5 on smithi080 2024-02-17T23:29:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:29:56.797701+0000 mon.c (mon.1) 223 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-17T23:29:58.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:56.832441+0000 mgr.y (mgr.44106) 207 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:29:56.788485+0000 mgr.y (mgr.44106) 205 : cephadm [INF] Upgrade: Updating osd.5 2024-02-17T23:29:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:56.793872+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:56.794954+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:29:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:56.795741+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:29:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:29:56.797136+0000 mgr.y (mgr.44106) 206 : cephadm [INF] Deploying daemon osd.5 on smithi080 2024-02-17T23:29:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:29:56.797701+0000 mon.c (mon.1) 223 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-17T23:29:58.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:56.832441+0000 mgr.y (mgr.44106) 207 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:29:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:29:56.788485+0000 mgr.y (mgr.44106) 205 : cephadm [INF] Upgrade: Updating osd.5 2024-02-17T23:29:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:56.793872+0000 mon.a (mon.0) 363 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:29:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:56.794954+0000 mon.c (mon.1) 221 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-02-17T23:29:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:56.795741+0000 mon.c (mon.1) 222 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:29:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:29:56.797136+0000 mgr.y (mgr.44106) 206 : cephadm [INF] Deploying daemon osd.5 on smithi080 2024-02-17T23:29:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:29:56.797701+0000 mon.c (mon.1) 223 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "container_image"}]: dispatch 2024-02-17T23:29:58.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:56.832441+0000 mgr.y (mgr.44106) 207 : cluster [DBG] pgmap v132: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:30:00.034 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:29:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:29:58.832878+0000 mgr.y (mgr.44106) 208 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:30:00.034 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:29:59 smithi080 systemd[1]: Stopping Ceph osd.5 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:30:00.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:29:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:29:58.832878+0000 mgr.y (mgr.44106) 208 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:30:00.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:29:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:29:58.832878+0000 mgr.y (mgr.44106) 208 : cluster [DBG] pgmap v133: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:30:00.389 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:00 smithi080 bash[40758]: debug 2024-02-17T23:30:00.030+0000 7f7b2f11d700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:30:00.390 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:00 smithi080 bash[40758]: debug 2024-02-17T23:30:00.030+0000 7f7b2f11d700 -1 osd.5 91 *** Got signal Terminated *** 2024-02-17T23:30:00.390 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:00 smithi080 bash[40758]: debug 2024-02-17T23:30:00.030+0000 7f7b2f11d700 -1 osd.5 91 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:30:00.824 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:00 smithi080 bash[58214]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.5 2024-02-17T23:30:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.000172+0000 mon.a (mon.0) 364 : cluster [INF] overall HEALTH_OK 2024-02-17T23:30:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.081291+0000 mon.a (mon.0) 365 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.081322+0000 mon.a (mon.0) 366 : cluster [INF] osd.5 failed (root=default,host=smithi080) (connection refused reported by osd.3) 2024-02-17T23:30:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.081581+0000 mon.a (mon.0) 367 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.081698+0000 mon.a (mon.0) 368 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.281440+0000 mon.a (mon.0) 369 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.281499+0000 mon.a (mon.0) 370 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.281656+0000 mon.a (mon.0) 371 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.281748+0000 mon.a (mon.0) 372 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.281879+0000 mon.a (mon.0) 373 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.282132+0000 mon.a (mon.0) 374 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.282265+0000 mon.a (mon.0) 375 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.282475+0000 mon.a (mon.0) 376 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.282630+0000 mon.a (mon.0) 377 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.282685+0000 mon.a (mon.0) 378 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.282840+0000 mon.a (mon.0) 379 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.282989+0000 mon.a (mon.0) 380 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.283136+0000 mon.a (mon.0) 381 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.283279+0000 mon.a (mon.0) 382 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.682250+0000 mon.a (mon.0) 383 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.000172+0000 mon.a (mon.0) 364 : cluster [INF] overall HEALTH_OK 2024-02-17T23:30:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.081291+0000 mon.a (mon.0) 365 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.081322+0000 mon.a (mon.0) 366 : cluster [INF] osd.5 failed (root=default,host=smithi080) (connection refused reported by osd.3) 2024-02-17T23:30:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.081581+0000 mon.a (mon.0) 367 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.081698+0000 mon.a (mon.0) 368 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.281440+0000 mon.a (mon.0) 369 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.281499+0000 mon.a (mon.0) 370 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.281656+0000 mon.a (mon.0) 371 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.281748+0000 mon.a (mon.0) 372 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.281879+0000 mon.a (mon.0) 373 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.282132+0000 mon.a (mon.0) 374 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.282265+0000 mon.a (mon.0) 375 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.282475+0000 mon.a (mon.0) 376 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.282630+0000 mon.a (mon.0) 377 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.282685+0000 mon.a (mon.0) 378 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.282840+0000 mon.a (mon.0) 379 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.282989+0000 mon.a (mon.0) 380 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.283136+0000 mon.a (mon.0) 381 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.283279+0000 mon.a (mon.0) 382 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.682250+0000 mon.a (mon.0) 383 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.682435+0000 mon.a (mon.0) 384 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.682540+0000 mon.a (mon.0) 385 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.682712+0000 mon.a (mon.0) 386 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.682797+0000 mon.a (mon.0) 387 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.683134+0000 mon.a (mon.0) 388 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.683282+0000 mon.a (mon.0) 389 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.683444+0000 mon.a (mon.0) 390 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.683605+0000 mon.a (mon.0) 391 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.683801+0000 mon.a (mon.0) 392 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.683941+0000 mon.a (mon.0) 393 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.684126+0000 mon.a (mon.0) 394 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.684221+0000 mon.a (mon.0) 395 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.684419+0000 mon.a (mon.0) 396 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.682435+0000 mon.a (mon.0) 384 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.682540+0000 mon.a (mon.0) 385 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.682712+0000 mon.a (mon.0) 386 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.682797+0000 mon.a (mon.0) 387 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.683134+0000 mon.a (mon.0) 388 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.683282+0000 mon.a (mon.0) 389 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.683444+0000 mon.a (mon.0) 390 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.683605+0000 mon.a (mon.0) 391 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.683801+0000 mon.a (mon.0) 392 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.683941+0000 mon.a (mon.0) 393 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.684126+0000 mon.a (mon.0) 394 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.684221+0000 mon.a (mon.0) 395 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.382 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.684419+0000 mon.a (mon.0) 396 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.000172+0000 mon.a (mon.0) 364 : cluster [INF] overall HEALTH_OK 2024-02-17T23:30:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.081291+0000 mon.a (mon.0) 365 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.081322+0000 mon.a (mon.0) 366 : cluster [INF] osd.5 failed (root=default,host=smithi080) (connection refused reported by osd.3) 2024-02-17T23:30:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.081581+0000 mon.a (mon.0) 367 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.081698+0000 mon.a (mon.0) 368 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.281440+0000 mon.a (mon.0) 369 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.281499+0000 mon.a (mon.0) 370 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.281656+0000 mon.a (mon.0) 371 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.281748+0000 mon.a (mon.0) 372 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.281879+0000 mon.a (mon.0) 373 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.282132+0000 mon.a (mon.0) 374 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.282265+0000 mon.a (mon.0) 375 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.282475+0000 mon.a (mon.0) 376 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.282630+0000 mon.a (mon.0) 377 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.282685+0000 mon.a (mon.0) 378 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.282840+0000 mon.a (mon.0) 379 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.282989+0000 mon.a (mon.0) 380 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.283136+0000 mon.a (mon.0) 381 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.283279+0000 mon.a (mon.0) 382 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.682250+0000 mon.a (mon.0) 383 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.682435+0000 mon.a (mon.0) 384 : cluster [DBG] osd.5 reported immediately failed by osd.3 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.682540+0000 mon.a (mon.0) 385 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.682712+0000 mon.a (mon.0) 386 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.682797+0000 mon.a (mon.0) 387 : cluster [DBG] osd.5 reported immediately failed by osd.1 2024-02-17T23:30:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.683134+0000 mon.a (mon.0) 388 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.683282+0000 mon.a (mon.0) 389 : cluster [DBG] osd.5 reported immediately failed by osd.6 2024-02-17T23:30:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.683444+0000 mon.a (mon.0) 390 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.683605+0000 mon.a (mon.0) 391 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.683801+0000 mon.a (mon.0) 392 : cluster [DBG] osd.5 reported immediately failed by osd.7 2024-02-17T23:30:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.683941+0000 mon.a (mon.0) 393 : cluster [DBG] osd.5 reported immediately failed by osd.0 2024-02-17T23:30:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.684126+0000 mon.a (mon.0) 394 : cluster [DBG] osd.5 reported immediately failed by osd.4 2024-02-17T23:30:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.684221+0000 mon.a (mon.0) 395 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:01.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.684419+0000 mon.a (mon.0) 396 : cluster [DBG] osd.5 reported immediately failed by osd.2 2024-02-17T23:30:02.100 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.833445+0000 mgr.y (mgr.44106) 209 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:30:02.100 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.888158+0000 mon.a (mon.0) 397 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:30:02.100 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:00.899398+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2024-02-17T23:30:02.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.833445+0000 mgr.y (mgr.44106) 209 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:30:02.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.888158+0000 mon.a (mon.0) 397 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:30:02.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:00.899398+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2024-02-17T23:30:02.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.833445+0000 mgr.y (mgr.44106) 209 : cluster [DBG] pgmap v134: 129 pgs: 129 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:30:02.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.888158+0000 mon.a (mon.0) 397 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:30:02.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:00.899398+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e92: 8 total, 7 up, 8 in 2024-02-17T23:30:03.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:01.901963+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2024-02-17T23:30:03.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:02 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.5.service: Succeeded. 2024-02-17T23:30:03.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:02 smithi080 systemd[1]: Stopped Ceph osd.5 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:30:03.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:02 smithi080 systemd[1]: Starting Ceph osd.5 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:30:03.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:01.901963+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2024-02-17T23:30:03.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:01.901963+0000 mon.a (mon.0) 399 : cluster [DBG] osdmap e93: 8 total, 7 up, 8 in 2024-02-17T23:30:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:02.833970+0000 mgr.y (mgr.44106) 210 : cluster [DBG] pgmap v137: 129 pgs: 14 peering, 13 stale+active+clean, 102 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:30:04.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:02.898994+0000 mon.a (mon.0) 400 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-02-17T23:30:04.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:03 smithi080 bash[58518]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-17T23:30:04.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:03 smithi080 bash[58518]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-17T23:30:04.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:03 smithi080 bash[58518]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-02-17T23:30:04.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:03 smithi080 bash[58518]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2024-02-17T23:30:04.142 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:03 smithi080 bash[58518]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-02-17T23:30:04.142 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:03 smithi080 bash[58518]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-02-17T23:30:04.142 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:03 smithi080 bash[58518]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-02-17T23:30:04.142 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:03 smithi080 bash[58518]: --> ceph-volume lvm activate successful for osd ID: 5 2024-02-17T23:30:04.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:02.833970+0000 mgr.y (mgr.44106) 210 : cluster [DBG] pgmap v137: 129 pgs: 14 peering, 13 stale+active+clean, 102 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:30:04.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:02.898994+0000 mon.a (mon.0) 400 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-02-17T23:30:04.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:02.833970+0000 mgr.y (mgr.44106) 210 : cluster [DBG] pgmap v137: 129 pgs: 14 peering, 13 stale+active+clean, 102 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail 2024-02-17T23:30:04.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:02.898994+0000 mon.a (mon.0) 400 : cluster [WRN] Health check failed: Reduced data availability: 4 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2024-02-17T23:30:05.043 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:30:04.918+0000 7f761f133700 1 -- 172.21.15.80:0/3823466373 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564a6ff10680 con 0x564a6fed7000 2024-02-17T23:30:05.043 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:05 smithi080 bash[58789]: c515261f8fad350dcaaa395f948af2a8af9bce3ca477b3be839ff4b46bd3c333 2024-02-17T23:30:05.043 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:04.905563+0000 mon.a (mon.0) 401 : cluster [WRN] Health check failed: Degraded data redundancy: 48/606 objects degraded (7.921%), 13 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:05.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:04.905563+0000 mon.a (mon.0) 401 : cluster [WRN] Health check failed: Degraded data redundancy: 48/606 objects degraded (7.921%), 13 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:05.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:04.905563+0000 mon.a (mon.0) 401 : cluster [WRN] Health check failed: Degraded data redundancy: 48/606 objects degraded (7.921%), 13 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:05.389 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:05 smithi080 systemd[1]: Started Ceph osd.5 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:30:05.890 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:30:05.442+0000 7f7626bc1380 -1 Falling back to public interface 2024-02-17T23:30:06.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:04.834872+0000 mgr.y (mgr.44106) 211 : cluster [DBG] pgmap v138: 129 pgs: 13 active+undersized+degraded, 14 peering, 1 stale+active+clean, 12 active+undersized, 89 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 48/606 objects degraded (7.921%) 2024-02-17T23:30:06.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:05.086612+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:06.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:05.088240+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:06.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:05.090001+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:30:06.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:04.834872+0000 mgr.y (mgr.44106) 211 : cluster [DBG] pgmap v138: 129 pgs: 13 active+undersized+degraded, 14 peering, 1 stale+active+clean, 12 active+undersized, 89 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 48/606 objects degraded (7.921%) 2024-02-17T23:30:06.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:05.086612+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:06.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:05.088240+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:06.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:05.090001+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:30:06.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:04.834872+0000 mgr.y (mgr.44106) 211 : cluster [DBG] pgmap v138: 129 pgs: 13 active+undersized+degraded, 14 peering, 1 stale+active+clean, 12 active+undersized, 89 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 48/606 objects degraded (7.921%) 2024-02-17T23:30:06.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:05.086612+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:06.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:05.088240+0000 mon.c (mon.1) 224 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:06.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:05.090001+0000 mon.c (mon.1) 225 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:30:07.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:07 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:07.086025+0000 mon.a (mon.0) 403 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 4 pgs peering) 2024-02-17T23:30:07.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:07.086025+0000 mon.a (mon.0) 403 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 4 pgs peering) 2024-02-17T23:30:07.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:07.086025+0000 mon.a (mon.0) 403 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 4 pgs peering) 2024-02-17T23:30:08.599 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:30:08.165+0000 7f7626bc1380 -1 osd.5 91 log_to_monitors {default=true} 2024-02-17T23:30:08.599 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:06.835525+0000 mgr.y (mgr.44106) 212 : cluster [DBG] pgmap v139: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:30:08.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:06.835525+0000 mgr.y (mgr.44106) 212 : cluster [DBG] pgmap v139: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:30:08.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:06.835525+0000 mgr.y (mgr.44106) 212 : cluster [DBG] pgmap v139: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:30:09.551 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:30:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:30:09.168+0000 7f76198ab700 -1 osd.5 91 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T23:30:09.551 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:08.169094+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/2349487958,v1:172.21.15.80:6809/2349487958]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:30:09.551 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:08.169777+0000 mon.a (mon.0) 404 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:30:09.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:08.169094+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/2349487958,v1:172.21.15.80:6809/2349487958]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:30:09.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:08.169777+0000 mon.a (mon.0) 404 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:30:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:08.169094+0000 mon.b (mon.2) 5 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/2349487958,v1:172.21.15.80:6809/2349487958]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:30:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:08.169777+0000 mon.a (mon.0) 404 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-02-17T23:30:10.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:08.836294+0000 mgr.y (mgr.44106) 213 : cluster [DBG] pgmap v140: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:30:10.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:09.147983+0000 mon.a (mon.0) 405 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-17T23:30:10.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:09.148065+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2024-02-17T23:30:10.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:09.149879+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/2349487958,v1:172.21.15.80:6809/2349487958]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:10.489 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:09.150345+0000 mon.a (mon.0) 407 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:08.836294+0000 mgr.y (mgr.44106) 213 : cluster [DBG] pgmap v140: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:30:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:09.147983+0000 mon.a (mon.0) 405 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-17T23:30:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:09.148065+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2024-02-17T23:30:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:09.149879+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/2349487958,v1:172.21.15.80:6809/2349487958]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:09.150345+0000 mon.a (mon.0) 407 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:08.836294+0000 mgr.y (mgr.44106) 213 : cluster [DBG] pgmap v140: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.4 GiB used, 711 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:30:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:09.147983+0000 mon.a (mon.0) 405 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-02-17T23:30:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:09.148065+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e94: 8 total, 7 up, 8 in 2024-02-17T23:30:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:09.149879+0000 mon.b (mon.2) 6 : audit [INF] from='osd.5 [v2:172.21.15.80:6808/2349487958,v1:172.21.15.80:6809/2349487958]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:09.150345+0000 mon.a (mon.0) 407 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:11.376 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:30:11.118+0000 7f36ce75d700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-17T23:30:11.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:10.144778+0000 mon.a (mon.0) 408 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:30:11.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:10.149373+0000 mon.a (mon.0) 409 : cluster [INF] osd.5 [v2:172.21.15.80:6808/2349487958,v1:172.21.15.80:6809/2349487958] boot 2024-02-17T23:30:11.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:10.149427+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:10.149952+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:10.739026+0000 mon.a (mon.0) 411 : cluster [WRN] Health check update: Degraded data redundancy: 67/606 objects degraded (11.056%), 18 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:10.818464+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:11.106269+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:11.112345+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:11.115382+0000 mon.c (mon.1) 228 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:11.116962+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:11.118208+0000 mon.c (mon.1) 230 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:11.119782+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:11.150649+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:10.144778+0000 mon.a (mon.0) 408 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:30:11.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:10.149373+0000 mon.a (mon.0) 409 : cluster [INF] osd.5 [v2:172.21.15.80:6808/2349487958,v1:172.21.15.80:6809/2349487958] boot 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:10.149427+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:10.149952+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:10.739026+0000 mon.a (mon.0) 411 : cluster [WRN] Health check update: Degraded data redundancy: 67/606 objects degraded (11.056%), 18 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:10.818464+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:11.106269+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:11.112345+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:11.115382+0000 mon.c (mon.1) 228 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:11.116962+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:11.118208+0000 mon.c (mon.1) 230 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:11.119782+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:11.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:11.150649+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-17T23:30:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:10.144778+0000 mon.a (mon.0) 408 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:30:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:10.149373+0000 mon.a (mon.0) 409 : cluster [INF] osd.5 [v2:172.21.15.80:6808/2349487958,v1:172.21.15.80:6809/2349487958] boot 2024-02-17T23:30:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:10.149427+0000 mon.a (mon.0) 410 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2024-02-17T23:30:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:10.149952+0000 mon.c (mon.1) 226 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-02-17T23:30:11.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:10.739026+0000 mon.a (mon.0) 411 : cluster [WRN] Health check update: Degraded data redundancy: 67/606 objects degraded (11.056%), 18 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:11.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:10.818464+0000 mon.a (mon.0) 412 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:11.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:11.106269+0000 mon.a (mon.0) 413 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:11.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:11.112345+0000 mon.c (mon.1) 227 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:11.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:11.115382+0000 mon.c (mon.1) 228 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:11.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:11.116962+0000 mon.c (mon.1) 229 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:11.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:11.118208+0000 mon.c (mon.1) 230 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:11.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:11.119782+0000 mon.c (mon.1) 231 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:11.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:11.150649+0000 mon.a (mon.0) 414 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2024-02-17T23:30:12.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:10.836765+0000 mgr.y (mgr.44106) 214 : cluster [DBG] pgmap v143: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:30:12.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:11.119955+0000 mgr.y (mgr.44106) 215 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:12.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:30:11.120839+0000 mgr.y (mgr.44106) 216 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-17T23:30:12.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:10.836765+0000 mgr.y (mgr.44106) 214 : cluster [DBG] pgmap v143: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:30:12.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:11.119955+0000 mgr.y (mgr.44106) 215 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:12.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:30:11.120839+0000 mgr.y (mgr.44106) 216 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-17T23:30:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:10.836765+0000 mgr.y (mgr.44106) 214 : cluster [DBG] pgmap v143: 129 pgs: 18 active+undersized+degraded, 26 active+undersized, 85 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:30:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:11.119955+0000 mgr.y (mgr.44106) 215 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:30:11.120839+0000 mgr.y (mgr.44106) 216 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-02-17T23:30:14.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:12.837421+0000 mgr.y (mgr.44106) 217 : cluster [DBG] pgmap v145: 129 pgs: 4 activating, 6 peering, 13 active+undersized+degraded, 21 active+undersized, 85 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 48/606 objects degraded (7.921%) 2024-02-17T23:30:14.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:14.108764+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:14.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:12.837421+0000 mgr.y (mgr.44106) 217 : cluster [DBG] pgmap v145: 129 pgs: 4 activating, 6 peering, 13 active+undersized+degraded, 21 active+undersized, 85 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 48/606 objects degraded (7.921%) 2024-02-17T23:30:14.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:14.108764+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:14.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:12.837421+0000 mgr.y (mgr.44106) 217 : cluster [DBG] pgmap v145: 129 pgs: 4 activating, 6 peering, 13 active+undersized+degraded, 21 active+undersized, 85 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 48/606 objects degraded (7.921%) 2024-02-17T23:30:14.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:14.108764+0000 mon.a (mon.0) 415 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:15.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:15.170909+0000 mon.a (mon.0) 416 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/606 objects degraded (7.921%), 13 pgs degraded) 2024-02-17T23:30:15.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:15.170941+0000 mon.a (mon.0) 417 : cluster [INF] Cluster is now healthy 2024-02-17T23:30:15.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:15.170909+0000 mon.a (mon.0) 416 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/606 objects degraded (7.921%), 13 pgs degraded) 2024-02-17T23:30:15.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:15.170941+0000 mon.a (mon.0) 417 : cluster [INF] Cluster is now healthy 2024-02-17T23:30:15.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:15.170909+0000 mon.a (mon.0) 416 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 48/606 objects degraded (7.921%), 13 pgs degraded) 2024-02-17T23:30:15.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:15.170941+0000 mon.a (mon.0) 417 : cluster [INF] Cluster is now healthy 2024-02-17T23:30:16.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:14.838159+0000 mgr.y (mgr.44106) 218 : cluster [DBG] pgmap v146: 129 pgs: 4 activating, 6 peering, 4 active+undersized, 115 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:16.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:14.838159+0000 mgr.y (mgr.44106) 218 : cluster [DBG] pgmap v146: 129 pgs: 4 activating, 6 peering, 4 active+undersized, 115 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:16.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:14.838159+0000 mgr.y (mgr.44106) 218 : cluster [DBG] pgmap v146: 129 pgs: 4 activating, 6 peering, 4 active+undersized, 115 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:18.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:16.838831+0000 mgr.y (mgr.44106) 219 : cluster [DBG] pgmap v147: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:18.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:16.838831+0000 mgr.y (mgr.44106) 219 : cluster [DBG] pgmap v147: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:18.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:16.838831+0000 mgr.y (mgr.44106) 219 : cluster [DBG] pgmap v147: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:19.708 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:30:20.358 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:30:20.358 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (5m) 70s ago 11m 24.6M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (10m) 9s ago 10m 34.3M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (4m) 9s ago 14m 384M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (4m) 70s ago 16m 423M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (4m) 70s ago 16m 54.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (3m) 9s ago 14m 54.6M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (3m) 70s ago 15m 49.8M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (11m) 70s ago 11m 12.6M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (11m) 9s ago 11m 13.8M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (2m) 70s ago 14m 41.2M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (2m) 70s ago 13m 39.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (104s) 70s ago 13m 36.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 f9b5c6109867 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (75s) 70s ago 13m 13.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 050f8c4e76bc 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (46s) 9s ago 13m 38.4M 4096M 16.2.14-548-g81bd20d6 823b921721f5 e57f1f319143 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (15s) 9s ago 12m 11.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 c515261f8fad 2024-02-17T23:30:20.359 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (12m) 9s ago 12m 46.0M 4096M 15.2.0 204a01f9b0b6 c392aabd1bed 2024-02-17T23:30:20.360 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (11m) 9s ago 11m 50.2M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:30:20.360 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (5m) 9s ago 11m 43.4M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:30:20.360 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (9m) 70s ago 9m 38.1M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:30:20.360 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (9m) 9s ago 9m 39.9M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:30:20.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:18.839558+0000 mgr.y (mgr.44106) 220 : cluster [DBG] pgmap v148: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:20.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:18.839558+0000 mgr.y (mgr.44106) 220 : cluster [DBG] pgmap v148: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:20.639 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:18.839558+0000 mgr.y (mgr.44106) 220 : cluster [DBG] pgmap v148: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:20.748 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:30:20.748 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2, 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 6 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:30:20.749 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:30:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:30:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 4, 2024-02-17T23:30:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 11 2024-02-17T23:30:20.750 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:30:20.750 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:30:21.074 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:30:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:30:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:30:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:30:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:30:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:30:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-02-17T23:30:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:30:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "11/20 daemons upgraded", 2024-02-17T23:30:21.074 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-02-17T23:30:21.075 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:30:21.075 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:30:21.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:19.694611+0000 mgr.y (mgr.44106) 221 : audit [DBG] from='client.54310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:21.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.025443+0000 mgr.y (mgr.44106) 222 : audit [DBG] from='client.44361 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:21.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.347529+0000 mon.c (mon.1) 232 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:21.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.347918+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:21.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.348252+0000 mon.c (mon.1) 234 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.348576+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.348892+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.349209+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.350830+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.351150+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.351454+0000 mon.c (mon.1) 240 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.351761+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.352057+0000 mon.c (mon.1) 242 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.747413+0000 mon.a (mon.0) 418 : audit [DBG] from='client.44373 172.21.15.5:0/2634119303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:19.694611+0000 mgr.y (mgr.44106) 221 : audit [DBG] from='client.54310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.025443+0000 mgr.y (mgr.44106) 222 : audit [DBG] from='client.44361 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.347529+0000 mon.c (mon.1) 232 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.347918+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.348252+0000 mon.c (mon.1) 234 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.348576+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.348892+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.349209+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.350830+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:21.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.351150+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.351454+0000 mon.c (mon.1) 240 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.351761+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.352057+0000 mon.c (mon.1) 242 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.747413+0000 mon.a (mon.0) 418 : audit [DBG] from='client.44373 172.21.15.5:0/2634119303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:21.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:19.694611+0000 mgr.y (mgr.44106) 221 : audit [DBG] from='client.54310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:21.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.025443+0000 mgr.y (mgr.44106) 222 : audit [DBG] from='client.44361 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:21.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.347529+0000 mon.c (mon.1) 232 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:21.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.347918+0000 mon.c (mon.1) 233 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:21.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.348252+0000 mon.c (mon.1) 234 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.348576+0000 mon.c (mon.1) 235 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.348892+0000 mon.c (mon.1) 236 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.349209+0000 mon.c (mon.1) 237 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.350830+0000 mon.c (mon.1) 238 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:21.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.351150+0000 mon.c (mon.1) 239 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.351454+0000 mon.c (mon.1) 240 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.351761+0000 mon.c (mon.1) 241 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.352057+0000 mon.c (mon.1) 242 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:21.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.747413+0000 mon.a (mon.0) 418 : audit [DBG] from='client.44373 172.21.15.5:0/2634119303' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:22.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:20.345744+0000 mgr.y (mgr.44106) 223 : audit [DBG] from='client.54322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:22.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:20.840046+0000 mgr.y (mgr.44106) 224 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:22.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:21.072539+0000 mgr.y (mgr.44106) 225 : audit [DBG] from='client.54334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:22.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:20.345744+0000 mgr.y (mgr.44106) 223 : audit [DBG] from='client.54322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:22.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:20.840046+0000 mgr.y (mgr.44106) 224 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:22.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:21.072539+0000 mgr.y (mgr.44106) 225 : audit [DBG] from='client.54334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:22.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:20.345744+0000 mgr.y (mgr.44106) 223 : audit [DBG] from='client.54322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:22.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:20.840046+0000 mgr.y (mgr.44106) 224 : cluster [DBG] pgmap v149: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:22.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:21.072539+0000 mgr.y (mgr.44106) 225 : audit [DBG] from='client.54334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:24.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:22.840586+0000 mgr.y (mgr.44106) 226 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:24.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:24.122181+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:24.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:22.840586+0000 mgr.y (mgr.44106) 226 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:24.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:24.122181+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:24.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:22.840586+0000 mgr.y (mgr.44106) 226 : cluster [DBG] pgmap v150: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:24.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:24.122181+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:26.566 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:24.841265+0000 mgr.y (mgr.44106) 227 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:26.566 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:26.131698+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:26.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:24.841265+0000 mgr.y (mgr.44106) 227 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:26.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:26.131698+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:26.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:24.841265+0000 mgr.y (mgr.44106) 227 : cluster [DBG] pgmap v151: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:26.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:26.131698+0000 mon.c (mon.1) 243 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:27.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:26.131885+0000 mgr.y (mgr.44106) 228 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:27.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:30:26.132977+0000 mgr.y (mgr.44106) 229 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-02-17T23:30:27.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:26.131885+0000 mgr.y (mgr.44106) 228 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:27.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:30:26.132977+0000 mgr.y (mgr.44106) 229 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-02-17T23:30:27.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:26.131885+0000 mgr.y (mgr.44106) 228 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["6"], "max": 16}]: dispatch 2024-02-17T23:30:27.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:30:26.132977+0000 mgr.y (mgr.44106) 229 : cephadm [INF] Upgrade: osd.6 is safe to restart 2024-02-17T23:30:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:26.841973+0000 mgr.y (mgr.44106) 230 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:30:27.696537+0000 mgr.y (mgr.44106) 231 : cephadm [INF] Upgrade: Updating osd.6 2024-02-17T23:30:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:27.701801+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:27.702840+0000 mon.c (mon.1) 244 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-17T23:30:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:27.703638+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:30:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:30:27.705023+0000 mgr.y (mgr.44106) 232 : cephadm [INF] Deploying daemon osd.6 on smithi080 2024-02-17T23:30:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:27.705552+0000 mon.c (mon.1) 246 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-17T23:30:28.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:26.841973+0000 mgr.y (mgr.44106) 230 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:28.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:30:27.696537+0000 mgr.y (mgr.44106) 231 : cephadm [INF] Upgrade: Updating osd.6 2024-02-17T23:30:28.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:27.701801+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:28.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:27.702840+0000 mon.c (mon.1) 244 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-17T23:30:28.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:27.703638+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:30:28.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:30:27.705023+0000 mgr.y (mgr.44106) 232 : cephadm [INF] Deploying daemon osd.6 on smithi080 2024-02-17T23:30:28.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:27.705552+0000 mon.c (mon.1) 246 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-17T23:30:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:26.841973+0000 mgr.y (mgr.44106) 230 : cluster [DBG] pgmap v152: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:30:27.696537+0000 mgr.y (mgr.44106) 231 : cephadm [INF] Upgrade: Updating osd.6 2024-02-17T23:30:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:27.701801+0000 mon.a (mon.0) 420 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:27.702840+0000 mon.c (mon.1) 244 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-02-17T23:30:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:27.703638+0000 mon.c (mon.1) 245 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:30:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:30:27.705023+0000 mgr.y (mgr.44106) 232 : cephadm [INF] Deploying daemon osd.6 on smithi080 2024-02-17T23:30:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:27.705552+0000 mon.c (mon.1) 246 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "container_image"}]: dispatch 2024-02-17T23:30:29.542 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:28.826060+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:30:29.542 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:28.826423+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.543 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:28.826591+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:30:29.543 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:28.826715+0000 mon.c (mon.1) 249 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-17T23:30:29.543 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:28.827128+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.543 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:28.827344+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.543 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:28.827759+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-17T23:30:29.543 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:28.828170+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.543 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:28.842495+0000 mgr.y (mgr.44106) 233 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:29.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:28.826060+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:30:29.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:28.826423+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:28.826591+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:30:29.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:28.826715+0000 mon.c (mon.1) 249 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-17T23:30:29.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:28.827128+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:28.827344+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:28.827759+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-17T23:30:29.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:28.828170+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:28.842495+0000 mgr.y (mgr.44106) 233 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:29.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:28.826060+0000 mon.c (mon.1) 247 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:30:29.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:28.826423+0000 mon.c (mon.1) 248 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:28.826591+0000 mon.a (mon.0) 421 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:30:29.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:28.826715+0000 mon.c (mon.1) 249 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-17T23:30:29.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:28.827128+0000 mon.c (mon.1) 250 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:28.827344+0000 mon.a (mon.0) 422 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:28.827759+0000 mon.a (mon.0) 423 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 5]}]: dispatch 2024-02-17T23:30:29.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:28.828170+0000 mon.a (mon.0) 424 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2024-02-17T23:30:29.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:28.842495+0000 mgr.y (mgr.44106) 233 : cluster [DBG] pgmap v153: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:31.027 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:30 smithi080 systemd[1]: Stopping Ceph osd.6 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:30:31.349 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:31 smithi080 bash[41341]: debug 2024-02-17T23:30:31.024+0000 7feac226f700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:30:31.349 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:31 smithi080 bash[41341]: debug 2024-02-17T23:30:31.024+0000 7feac226f700 -1 osd.6 96 *** Got signal Terminated *** 2024-02-17T23:30:31.349 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:31 smithi080 bash[41341]: debug 2024-02-17T23:30:31.024+0000 7feac226f700 -1 osd.6 96 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:30:31.640 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:31 smithi080 bash[59961]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.6 2024-02-17T23:30:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:30.843130+0000 mgr.y (mgr.44106) 234 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.082378+0000 mon.a (mon.0) 425 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.082434+0000 mon.a (mon.0) 426 : cluster [INF] osd.6 failed (root=default,host=smithi080) (connection refused reported by osd.3) 2024-02-17T23:30:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.082767+0000 mon.a (mon.0) 427 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.082944+0000 mon.a (mon.0) 428 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.083133+0000 mon.a (mon.0) 429 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.083299+0000 mon.a (mon.0) 430 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.156673+0000 mon.a (mon.0) 431 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.282504+0000 mon.a (mon.0) 432 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.282640+0000 mon.a (mon.0) 433 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.283214+0000 mon.a (mon.0) 434 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.283312+0000 mon.a (mon.0) 435 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.283652+0000 mon.a (mon.0) 436 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.283814+0000 mon.a (mon.0) 437 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.283960+0000 mon.a (mon.0) 438 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.284117+0000 mon.a (mon.0) 439 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.284256+0000 mon.a (mon.0) 440 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.284423+0000 mon.a (mon.0) 441 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.284548+0000 mon.a (mon.0) 442 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.284708+0000 mon.a (mon.0) 443 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:30.843130+0000 mgr.y (mgr.44106) 234 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.082378+0000 mon.a (mon.0) 425 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.082434+0000 mon.a (mon.0) 426 : cluster [INF] osd.6 failed (root=default,host=smithi080) (connection refused reported by osd.3) 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.082767+0000 mon.a (mon.0) 427 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.082944+0000 mon.a (mon.0) 428 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.083133+0000 mon.a (mon.0) 429 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.083299+0000 mon.a (mon.0) 430 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.156673+0000 mon.a (mon.0) 431 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.282504+0000 mon.a (mon.0) 432 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.282640+0000 mon.a (mon.0) 433 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.283214+0000 mon.a (mon.0) 434 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.283312+0000 mon.a (mon.0) 435 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.283652+0000 mon.a (mon.0) 436 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.283814+0000 mon.a (mon.0) 437 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.283960+0000 mon.a (mon.0) 438 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.284117+0000 mon.a (mon.0) 439 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.284256+0000 mon.a (mon.0) 440 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.284423+0000 mon.a (mon.0) 441 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.284548+0000 mon.a (mon.0) 442 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.284708+0000 mon.a (mon.0) 443 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.284831+0000 mon.a (mon.0) 444 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.284992+0000 mon.a (mon.0) 445 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.357301+0000 mon.a (mon.0) 446 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.683281+0000 mon.a (mon.0) 447 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.683427+0000 mon.a (mon.0) 448 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.684236+0000 mon.a (mon.0) 449 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.684335+0000 mon.a (mon.0) 450 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.684540+0000 mon.a (mon.0) 451 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.684822+0000 mon.a (mon.0) 452 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.684984+0000 mon.a (mon.0) 453 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.685164+0000 mon.a (mon.0) 454 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.685371+0000 mon.a (mon.0) 455 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.685584+0000 mon.a (mon.0) 456 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.685797+0000 mon.a (mon.0) 457 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.686010+0000 mon.a (mon.0) 458 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.686239+0000 mon.a (mon.0) 459 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.686449+0000 mon.a (mon.0) 460 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.758330+0000 mon.a (mon.0) 461 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.284831+0000 mon.a (mon.0) 444 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.284992+0000 mon.a (mon.0) 445 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.357301+0000 mon.a (mon.0) 446 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.683281+0000 mon.a (mon.0) 447 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.683427+0000 mon.a (mon.0) 448 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.684236+0000 mon.a (mon.0) 449 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.684335+0000 mon.a (mon.0) 450 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.684540+0000 mon.a (mon.0) 451 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.684822+0000 mon.a (mon.0) 452 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.684984+0000 mon.a (mon.0) 453 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.685164+0000 mon.a (mon.0) 454 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.685371+0000 mon.a (mon.0) 455 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.685584+0000 mon.a (mon.0) 456 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.685797+0000 mon.a (mon.0) 457 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.686010+0000 mon.a (mon.0) 458 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.686239+0000 mon.a (mon.0) 459 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.686449+0000 mon.a (mon.0) 460 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.382 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.758330+0000 mon.a (mon.0) 461 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:30.843130+0000 mgr.y (mgr.44106) 234 : cluster [DBG] pgmap v154: 129 pgs: 129 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.082378+0000 mon.a (mon.0) 425 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.082434+0000 mon.a (mon.0) 426 : cluster [INF] osd.6 failed (root=default,host=smithi080) (connection refused reported by osd.3) 2024-02-17T23:30:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.082767+0000 mon.a (mon.0) 427 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.082944+0000 mon.a (mon.0) 428 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.083133+0000 mon.a (mon.0) 429 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.083299+0000 mon.a (mon.0) 430 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.156673+0000 mon.a (mon.0) 431 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.282504+0000 mon.a (mon.0) 432 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.282640+0000 mon.a (mon.0) 433 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.283214+0000 mon.a (mon.0) 434 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.283312+0000 mon.a (mon.0) 435 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.283652+0000 mon.a (mon.0) 436 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.283814+0000 mon.a (mon.0) 437 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.283960+0000 mon.a (mon.0) 438 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.284117+0000 mon.a (mon.0) 439 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.284256+0000 mon.a (mon.0) 440 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.284423+0000 mon.a (mon.0) 441 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.284548+0000 mon.a (mon.0) 442 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.284708+0000 mon.a (mon.0) 443 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.284831+0000 mon.a (mon.0) 444 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.284992+0000 mon.a (mon.0) 445 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.357301+0000 mon.a (mon.0) 446 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.683281+0000 mon.a (mon.0) 447 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.683427+0000 mon.a (mon.0) 448 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.684236+0000 mon.a (mon.0) 449 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.684335+0000 mon.a (mon.0) 450 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.684540+0000 mon.a (mon.0) 451 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.684822+0000 mon.a (mon.0) 452 : cluster [DBG] osd.6 reported immediately failed by osd.4 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.684984+0000 mon.a (mon.0) 453 : cluster [DBG] osd.6 reported immediately failed by osd.1 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.685164+0000 mon.a (mon.0) 454 : cluster [DBG] osd.6 reported immediately failed by osd.3 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.685371+0000 mon.a (mon.0) 455 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.685584+0000 mon.a (mon.0) 456 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.685797+0000 mon.a (mon.0) 457 : cluster [DBG] osd.6 reported immediately failed by osd.0 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.686010+0000 mon.a (mon.0) 458 : cluster [DBG] osd.6 reported immediately failed by osd.5 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.686239+0000 mon.a (mon.0) 459 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.686449+0000 mon.a (mon.0) 460 : cluster [DBG] osd.6 reported immediately failed by osd.2 2024-02-17T23:30:32.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.758330+0000 mon.a (mon.0) 461 : cluster [DBG] osd.6 reported immediately failed by osd.7 2024-02-17T23:30:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.896392+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:30:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:31.901252+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2024-02-17T23:30:33.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:32.903020+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2024-02-17T23:30:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.896392+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:30:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:31.901252+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2024-02-17T23:30:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:32.903020+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2024-02-17T23:30:33.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.896392+0000 mon.a (mon.0) 462 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:30:33.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:31.901252+0000 mon.a (mon.0) 463 : cluster [DBG] osdmap e97: 8 total, 7 up, 8 in 2024-02-17T23:30:33.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:32.903020+0000 mon.a (mon.0) 464 : cluster [DBG] osdmap e98: 8 total, 7 up, 8 in 2024-02-17T23:30:33.881 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:33 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.6.service: Succeeded. 2024-02-17T23:30:33.881 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:33 smithi080 systemd[1]: Stopped Ceph osd.6 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:30:33.881 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:33 smithi080 systemd[1]: Starting Ceph osd.6 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:30:34.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:32.843604+0000 mgr.y (mgr.44106) 235 : cluster [DBG] pgmap v156: 129 pgs: 13 stale+active+clean, 116 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:34.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:32.843604+0000 mgr.y (mgr.44106) 235 : cluster [DBG] pgmap v156: 129 pgs: 13 stale+active+clean, 116 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:34.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:32.843604+0000 mgr.y (mgr.44106) 235 : cluster [DBG] pgmap v156: 129 pgs: 13 stale+active+clean, 116 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:30:34.640 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:34 smithi080 bash[60260]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-17T23:30:34.640 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:34 smithi080 bash[60260]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-17T23:30:34.640 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:34 smithi080 bash[60260]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2024-02-17T23:30:34.640 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:34 smithi080 bash[60260]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2024-02-17T23:30:34.640 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:34 smithi080 bash[60260]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2024-02-17T23:30:34.641 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:34 smithi080 bash[60260]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-02-17T23:30:34.641 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:34 smithi080 bash[60260]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-02-17T23:30:34.641 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:34 smithi080 bash[60260]: --> ceph-volume lvm activate successful for osd ID: 6 2024-02-17T23:30:35.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:34.921329+0000 mon.a (mon.0) 465 : cluster [WRN] Health check failed: Degraded data redundancy: 61/606 objects degraded (10.066%), 10 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:35.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:34.921329+0000 mon.a (mon.0) 465 : cluster [WRN] Health check failed: Degraded data redundancy: 61/606 objects degraded (10.066%), 10 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:35.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:34.921329+0000 mon.a (mon.0) 465 : cluster [WRN] Health check failed: Degraded data redundancy: 61/606 objects degraded (10.066%), 10 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:35.890 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:30:35.587+0000 7fe32592c700 1 -- 172.21.15.80:0/3532250177 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5620b8290680 con 0x5620b8257000 2024-02-17T23:30:35.890 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:35 smithi080 bash[60527]: 041e8ef3bef552734d8d91163e222e22999469e29c390a3d523aef35d7263b97 2024-02-17T23:30:35.890 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:35 smithi080 systemd[1]: Started Ceph osd.6 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:30:36.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:34.844244+0000 mgr.y (mgr.44106) 236 : cluster [DBG] pgmap v158: 129 pgs: 13 activating+undersized, 10 active+undersized+degraded, 3 stale+active+clean, 13 active+undersized, 90 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 61/606 objects degraded (10.066%) 2024-02-17T23:30:36.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:35.712200+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:36.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:35.713688+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:36.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:35.716142+0000 mon.c (mon.1) 252 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:30:36.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:34.844244+0000 mgr.y (mgr.44106) 236 : cluster [DBG] pgmap v158: 129 pgs: 13 activating+undersized, 10 active+undersized+degraded, 3 stale+active+clean, 13 active+undersized, 90 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 61/606 objects degraded (10.066%) 2024-02-17T23:30:36.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:35.712200+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:36.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:35.713688+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:36.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:35.716142+0000 mon.c (mon.1) 252 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:30:36.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:30:36.114+0000 7fe32d3ba380 -1 Falling back to public interface 2024-02-17T23:30:36.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:34.844244+0000 mgr.y (mgr.44106) 236 : cluster [DBG] pgmap v158: 129 pgs: 13 activating+undersized, 10 active+undersized+degraded, 3 stale+active+clean, 13 active+undersized, 90 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 61/606 objects degraded (10.066%) 2024-02-17T23:30:36.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:35.712200+0000 mon.a (mon.0) 466 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:36.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:35.713688+0000 mon.c (mon.1) 251 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:36.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:35.716142+0000 mon.c (mon.1) 252 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:30:38.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:36.844976+0000 mgr.y (mgr.44106) 237 : cluster [DBG] pgmap v159: 129 pgs: 13 activating+undersized, 13 active+undersized+degraded, 17 active+undersized, 86 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 73/606 objects degraded (12.046%) 2024-02-17T23:30:38.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:36.844976+0000 mgr.y (mgr.44106) 237 : cluster [DBG] pgmap v159: 129 pgs: 13 activating+undersized, 13 active+undersized+degraded, 17 active+undersized, 86 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 73/606 objects degraded (12.046%) 2024-02-17T23:30:38.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:36.844976+0000 mgr.y (mgr.44106) 237 : cluster [DBG] pgmap v159: 129 pgs: 13 activating+undersized, 13 active+undersized+degraded, 17 active+undersized, 86 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 73/606 objects degraded (12.046%) 2024-02-17T23:30:39.001 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:38.878557+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/3718299902,v1:172.21.15.80:6817/3718299902]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:30:39.002 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:38.878975+0000 mon.a (mon.0) 467 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:30:39.002 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:30:38.874+0000 7fe32d3ba380 -1 osd.6 96 log_to_monitors {default=true} 2024-02-17T23:30:39.002 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:30:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:30:38.998+0000 7fe31d89f700 -1 osd.6 96 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T23:30:39.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:38.878557+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/3718299902,v1:172.21.15.80:6817/3718299902]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:30:39.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:38.878975+0000 mon.a (mon.0) 467 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:30:39.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:38.878557+0000 mon.b (mon.2) 7 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/3718299902,v1:172.21.15.80:6817/3718299902]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:30:39.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:38.878975+0000 mon.a (mon.0) 467 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-02-17T23:30:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:38.845612+0000 mgr.y (mgr.44106) 238 : cluster [DBG] pgmap v160: 129 pgs: 18 active+undersized+degraded, 25 active+undersized, 86 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 73/606 objects degraded (12.046%) 2024-02-17T23:30:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:38.985498+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-17T23:30:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:38.985601+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2024-02-17T23:30:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:38.988231+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/3718299902,v1:172.21.15.80:6817/3718299902]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:40.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:38.988973+0000 mon.a (mon.0) 470 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:40.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:38.845612+0000 mgr.y (mgr.44106) 238 : cluster [DBG] pgmap v160: 129 pgs: 18 active+undersized+degraded, 25 active+undersized, 86 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 73/606 objects degraded (12.046%) 2024-02-17T23:30:40.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:38.985498+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-17T23:30:40.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:38.985601+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2024-02-17T23:30:40.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:38.988231+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/3718299902,v1:172.21.15.80:6817/3718299902]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:40.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:38.988973+0000 mon.a (mon.0) 470 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:40.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:38.845612+0000 mgr.y (mgr.44106) 238 : cluster [DBG] pgmap v160: 129 pgs: 18 active+undersized+degraded, 25 active+undersized, 86 active+clean; 7.0 KiB data, 1.7 GiB used, 712 GiB / 715 GiB avail; 73/606 objects degraded (12.046%) 2024-02-17T23:30:40.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:38.985498+0000 mon.a (mon.0) 468 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-02-17T23:30:40.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:38.985601+0000 mon.a (mon.0) 469 : cluster [DBG] osdmap e99: 8 total, 7 up, 8 in 2024-02-17T23:30:40.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:38.988231+0000 mon.b (mon.2) 8 : audit [INF] from='osd.6 [v2:172.21.15.80:6816/3718299902,v1:172.21.15.80:6817/3718299902]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:40.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:38.988973+0000 mon.a (mon.0) 470 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:30:41.376 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:30:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:30:40.926+0000 7f36ce75d700 -1 mgr.server reply reply (16) Device or resource busy unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-17T23:30:41.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:39.982724+0000 mon.a (mon.0) 471 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:30:41.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:39.987565+0000 mon.a (mon.0) 472 : cluster [INF] osd.6 [v2:172.21.15.80:6816/3718299902,v1:172.21.15.80:6817/3718299902] boot 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:39.987639+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:39.988221+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:40.743263+0000 mon.a (mon.0) 474 : cluster [WRN] Health check update: Degraded data redundancy: 73/606 objects degraded (12.046%), 18 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:40.908390+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:40.913932+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:40.919909+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:40.923088+0000 mon.c (mon.1) 255 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:40.924643+0000 mon.c (mon.1) 256 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:40.925778+0000 mon.c (mon.1) 257 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:40.927276+0000 mon.c (mon.1) 258 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:40.988591+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-17T23:30:41.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:39.982724+0000 mon.a (mon.0) 471 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:39.987565+0000 mon.a (mon.0) 472 : cluster [INF] osd.6 [v2:172.21.15.80:6816/3718299902,v1:172.21.15.80:6817/3718299902] boot 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:39.987639+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:39.988221+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:40.743263+0000 mon.a (mon.0) 474 : cluster [WRN] Health check update: Degraded data redundancy: 73/606 objects degraded (12.046%), 18 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:40.908390+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:40.913932+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:40.919909+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:40.923088+0000 mon.c (mon.1) 255 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:40.924643+0000 mon.c (mon.1) 256 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:40.925778+0000 mon.c (mon.1) 257 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:40.927276+0000 mon.c (mon.1) 258 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:41.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:40.988591+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-17T23:30:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:39.982724+0000 mon.a (mon.0) 471 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:30:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:39.987565+0000 mon.a (mon.0) 472 : cluster [INF] osd.6 [v2:172.21.15.80:6816/3718299902,v1:172.21.15.80:6817/3718299902] boot 2024-02-17T23:30:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:39.987639+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e100: 8 total, 8 up, 8 in 2024-02-17T23:30:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:39.988221+0000 mon.c (mon.1) 253 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-02-17T23:30:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:40.743263+0000 mon.a (mon.0) 474 : cluster [WRN] Health check update: Degraded data redundancy: 73/606 objects degraded (12.046%), 18 pgs degraded (PG_DEGRADED) 2024-02-17T23:30:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:40.908390+0000 mon.a (mon.0) 475 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:40.913932+0000 mon.a (mon.0) 476 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:40.919909+0000 mon.c (mon.1) 254 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:30:41.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:40.923088+0000 mon.c (mon.1) 255 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:41.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:40.924643+0000 mon.c (mon.1) 256 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:41.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:40.925778+0000 mon.c (mon.1) 257 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:41.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:40.927276+0000 mon.c (mon.1) 258 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:41.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:40.988591+0000 mon.a (mon.0) 477 : cluster [DBG] osdmap e101: 8 total, 8 up, 8 in 2024-02-17T23:30:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:40.846287+0000 mgr.y (mgr.44106) 239 : cluster [DBG] pgmap v163: 129 pgs: 18 active+undersized+degraded, 25 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 73/606 objects degraded (12.046%) 2024-02-17T23:30:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:40.927440+0000 mgr.y (mgr.44106) 240 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:30:40.928243+0000 mgr.y (mgr.44106) 241 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-17T23:30:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:40.846287+0000 mgr.y (mgr.44106) 239 : cluster [DBG] pgmap v163: 129 pgs: 18 active+undersized+degraded, 25 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 73/606 objects degraded (12.046%) 2024-02-17T23:30:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:40.927440+0000 mgr.y (mgr.44106) 240 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:30:40.928243+0000 mgr.y (mgr.44106) 241 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-17T23:30:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:40.846287+0000 mgr.y (mgr.44106) 239 : cluster [DBG] pgmap v163: 129 pgs: 18 active+undersized+degraded, 25 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 73/606 objects degraded (12.046%) 2024-02-17T23:30:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:40.927440+0000 mgr.y (mgr.44106) 240 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:30:40.928243+0000 mgr.y (mgr.44106) 241 : cephadm [INF] Upgrade: unsafe to stop osd(s) at this time (16 PGs are or would become offline) 2024-02-17T23:30:44.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:44 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:42.846930+0000 mgr.y (mgr.44106) 242 : cluster [DBG] pgmap v165: 129 pgs: 16 active+undersized+degraded, 23 active+undersized, 90 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 63/606 objects degraded (10.396%) 2024-02-17T23:30:44.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:44 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:42.846930+0000 mgr.y (mgr.44106) 242 : cluster [DBG] pgmap v165: 129 pgs: 16 active+undersized+degraded, 23 active+undersized, 90 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 63/606 objects degraded (10.396%) 2024-02-17T23:30:44.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:44 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:42.846930+0000 mgr.y (mgr.44106) 242 : cluster [DBG] pgmap v165: 129 pgs: 16 active+undersized+degraded, 23 active+undersized, 90 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 63/606 objects degraded (10.396%) 2024-02-17T23:30:45.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:45.007920+0000 mon.a (mon.0) 478 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/606 objects degraded (10.396%), 16 pgs degraded) 2024-02-17T23:30:45.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:45.007948+0000 mon.a (mon.0) 479 : cluster [INF] Cluster is now healthy 2024-02-17T23:30:45.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:45.007920+0000 mon.a (mon.0) 478 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/606 objects degraded (10.396%), 16 pgs degraded) 2024-02-17T23:30:45.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:45.007948+0000 mon.a (mon.0) 479 : cluster [INF] Cluster is now healthy 2024-02-17T23:30:45.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:45.007920+0000 mon.a (mon.0) 478 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/606 objects degraded (10.396%), 16 pgs degraded) 2024-02-17T23:30:45.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:45.007948+0000 mon.a (mon.0) 479 : cluster [INF] Cluster is now healthy 2024-02-17T23:30:46.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:44.847800+0000 mgr.y (mgr.44106) 243 : cluster [DBG] pgmap v166: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 33 KiB/s rd, 0 B/s wr, 55 op/s 2024-02-17T23:30:46.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:44.847800+0000 mgr.y (mgr.44106) 243 : cluster [DBG] pgmap v166: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 33 KiB/s rd, 0 B/s wr, 55 op/s 2024-02-17T23:30:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:44.847800+0000 mgr.y (mgr.44106) 243 : cluster [DBG] pgmap v166: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 33 KiB/s rd, 0 B/s wr, 55 op/s 2024-02-17T23:30:47.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:30:46 smithi005 bash[57630]: ts=2024-02-17T23:30:46.953Z caller=dispatch.go:352 level=error component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="web.hook/webhook[0]: notify retry canceled after 16 attempts: Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-17T23:30:47.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:30:46 smithi005 bash[57630]: ts=2024-02-17T23:30:46.954Z caller=notify.go:745 level=warn component=dispatcher receiver=web.hook integration=webhook[0] aggrGroup="{}:{alertname=\"CephNodeDiskspaceWarning\"}" msg="Notify attempt failed, will retry later" attempts=1 err="Post \"\": dial tcp 127.0.0.1:5001: connect: connection refused" 2024-02-17T23:30:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:46.848316+0000 mgr.y (mgr.44106) 244 : cluster [DBG] pgmap v167: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 45 KiB/s rd, 0 B/s wr, 75 op/s 2024-02-17T23:30:48.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:46.848316+0000 mgr.y (mgr.44106) 244 : cluster [DBG] pgmap v167: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 45 KiB/s rd, 0 B/s wr, 75 op/s 2024-02-17T23:30:48.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:46.848316+0000 mgr.y (mgr.44106) 244 : cluster [DBG] pgmap v167: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 45 KiB/s rd, 0 B/s wr, 75 op/s 2024-02-17T23:30:50.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:50 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:48.848804+0000 mgr.y (mgr.44106) 245 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 65 KiB/s rd, 0 B/s wr, 108 op/s 2024-02-17T23:30:50.656 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:50 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:49.140591+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:50.656 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:50 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:48.848804+0000 mgr.y (mgr.44106) 245 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 65 KiB/s rd, 0 B/s wr, 108 op/s 2024-02-17T23:30:50.656 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:50 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:49.140591+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:50.656 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:50 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:48.848804+0000 mgr.y (mgr.44106) 245 : cluster [DBG] pgmap v168: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 65 KiB/s rd, 0 B/s wr, 108 op/s 2024-02-17T23:30:50.657 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:50 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:49.140591+0000 mon.a (mon.0) 480 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:51.429 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:30:52.078 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:30:52.078 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (5m) 102s ago 11m 24.6M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:30:52.078 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (11m) 11s ago 11m 34.6M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:30:52.078 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (4m) 11s ago 15m 384M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:30:52.078 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (5m) 102s ago 17m 423M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:30:52.078 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (4m) 102s ago 17m 54.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:30:52.078 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (4m) 11s ago 15m 57.8M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:30:52.078 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (4m) 102s ago 15m 49.8M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:30:52.078 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (11m) 102s ago 11m 12.6M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:30:52.078 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (11m) 11s ago 11m 13.8M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (3m) 102s ago 14m 41.2M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (2m) 102s ago 14m 39.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (2m) 102s ago 14m 36.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 f9b5c6109867 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (107s) 102s ago 13m 13.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 050f8c4e76bc 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (77s) 11s ago 13m 39.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 e57f1f319143 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (47s) 11s ago 13m 38.0M 4096M 16.2.14-548-g81bd20d6 823b921721f5 c515261f8fad 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (16s) 11s ago 12m 10.7M 4096M 16.2.14-548-g81bd20d6 823b921721f5 041e8ef3bef5 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (12m) 11s ago 12m 51.1M 4096M 15.2.0 204a01f9b0b6 74ef9ff13606 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (5m) 11s ago 11m 47.8M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (10m) 102s ago 10m 38.1M - 15.2.0 204a01f9b0b6 5000712a390b 2024-02-17T23:30:52.079 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (10m) 11s ago 10m 40.1M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 1, 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 7 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:30:52.479 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:30:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 2 2024-02-17T23:30:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:30:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:30:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 15.2.0 (dc6a0b5c3cbf6a5e1d6d4f20b5ad466d76b96247) octopus (rc)": 3, 2024-02-17T23:30:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 12 2024-02-17T23:30:52.480 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:30:52.480 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:30:52.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:50.849327+0000 mgr.y (mgr.44106) 246 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 76 KiB/s rd, 0 B/s wr, 126 op/s 2024-02-17T23:30:52.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.067187+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:52.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.067529+0000 mon.c (mon.1) 260 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:52.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.067814+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.068119+0000 mon.c (mon.1) 262 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.068400+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.068679+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.070291+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:52.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.070563+0000 mon.c (mon.1) 266 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.070845+0000 mon.c (mon.1) 267 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.071129+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.071412+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:50.849327+0000 mgr.y (mgr.44106) 246 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 76 KiB/s rd, 0 B/s wr, 126 op/s 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.067187+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.067529+0000 mon.c (mon.1) 260 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.067814+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.068119+0000 mon.c (mon.1) 262 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.068400+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.068679+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.070291+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.070563+0000 mon.c (mon.1) 266 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.070845+0000 mon.c (mon.1) 267 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.071129+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.071412+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:50.849327+0000 mgr.y (mgr.44106) 246 : cluster [DBG] pgmap v169: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 76 KiB/s rd, 0 B/s wr, 126 op/s 2024-02-17T23:30:52.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.067187+0000 mon.c (mon.1) 259 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:52.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.067529+0000 mon.c (mon.1) 260 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:52.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.067814+0000 mon.c (mon.1) 261 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.068119+0000 mon.c (mon.1) 262 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.068400+0000 mon.c (mon.1) 263 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.068679+0000 mon.c (mon.1) 264 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.070291+0000 mon.c (mon.1) 265 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:30:52.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.070563+0000 mon.c (mon.1) 266 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.070845+0000 mon.c (mon.1) 267 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.071129+0000 mon.c (mon.1) 268 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.071412+0000 mon.c (mon.1) 269 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:30:52.805 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:30:52.806 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:30:52.806 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:30:52.806 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:30:52.806 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:30:52.806 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:30:52.806 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-02-17T23:30:52.806 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:30:52.806 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "12/20 daemons upgraded", 2024-02-17T23:30:52.806 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading osd daemons", 2024-02-17T23:30:52.806 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:30:52.807 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:30:53.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:51.416794+0000 mgr.y (mgr.44106) 247 : audit [DBG] from='client.44391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:53.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:51.743821+0000 mgr.y (mgr.44106) 248 : audit [DBG] from='client.54352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:53.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.065379+0000 mgr.y (mgr.44106) 249 : audit [DBG] from='client.44403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:53.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.477612+0000 mon.c (mon.1) 270 : audit [DBG] from='client.44409 172.21.15.5:0/58300120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:53.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:51.416794+0000 mgr.y (mgr.44106) 247 : audit [DBG] from='client.44391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:53.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:51.743821+0000 mgr.y (mgr.44106) 248 : audit [DBG] from='client.54352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:53.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.065379+0000 mgr.y (mgr.44106) 249 : audit [DBG] from='client.44403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:53.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.477612+0000 mon.c (mon.1) 270 : audit [DBG] from='client.44409 172.21.15.5:0/58300120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:53.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:51.416794+0000 mgr.y (mgr.44106) 247 : audit [DBG] from='client.44391 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:53.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:51.743821+0000 mgr.y (mgr.44106) 248 : audit [DBG] from='client.54352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:53.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.065379+0000 mgr.y (mgr.44106) 249 : audit [DBG] from='client.44403 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:53.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.477612+0000 mon.c (mon.1) 270 : audit [DBG] from='client.44409 172.21.15.5:0/58300120' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:30:54.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:54 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:52.804072+0000 mgr.y (mgr.44106) 250 : audit [DBG] from='client.54370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:54.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:54 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:52.849813+0000 mgr.y (mgr.44106) 251 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 120 op/s 2024-02-17T23:30:54.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:54 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:52.804072+0000 mgr.y (mgr.44106) 250 : audit [DBG] from='client.54370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:54.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:54 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:52.849813+0000 mgr.y (mgr.44106) 251 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 120 op/s 2024-02-17T23:30:54.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:54 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:52.804072+0000 mgr.y (mgr.44106) 250 : audit [DBG] from='client.54370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:30:54.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:54 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:52.849813+0000 mgr.y (mgr.44106) 251 : cluster [DBG] pgmap v170: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 120 op/s 2024-02-17T23:30:56.419 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:54.850441+0000 mgr.y (mgr.44106) 252 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-17T23:30:56.419 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:55.943787+0000 mon.c (mon.1) 271 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:56.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:54.850441+0000 mgr.y (mgr.44106) 252 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-17T23:30:56.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:55.943787+0000 mon.c (mon.1) 271 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:56.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:54.850441+0000 mgr.y (mgr.44106) 252 : cluster [DBG] pgmap v171: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 71 KiB/s rd, 0 B/s wr, 119 op/s 2024-02-17T23:30:56.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:55.943787+0000 mon.c (mon.1) 271 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:57.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:55.944016+0000 mgr.y (mgr.44106) 253 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:57.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:30:55.945179+0000 mgr.y (mgr.44106) 254 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-02-17T23:30:57.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:55.944016+0000 mgr.y (mgr.44106) 253 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:57.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:30:55.945179+0000 mgr.y (mgr.44106) 254 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-02-17T23:30:57.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:55.944016+0000 mgr.y (mgr.44106) 253 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["7"], "max": 16}]: dispatch 2024-02-17T23:30:57.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:30:55.945179+0000 mgr.y (mgr.44106) 254 : cephadm [INF] Upgrade: osd.7 is safe to restart 2024-02-17T23:30:58.243 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:56.851134+0000 mgr.y (mgr.44106) 255 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-02-17T23:30:58.243 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:57.541119+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:58.243 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:57.542159+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-17T23:30:58.243 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:57.542930+0000 mon.c (mon.1) 273 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:30:58.243 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:30:57.544775+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-17T23:30:58.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:56.851134+0000 mgr.y (mgr.44106) 255 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-02-17T23:30:58.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:57.541119+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:58.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:57.542159+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-17T23:30:58.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:57.542930+0000 mon.c (mon.1) 273 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:30:58.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:30:57.544775+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-17T23:30:58.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:56.851134+0000 mgr.y (mgr.44106) 255 : cluster [DBG] pgmap v172: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 55 KiB/s rd, 0 B/s wr, 91 op/s 2024-02-17T23:30:58.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:57.541119+0000 mon.a (mon.0) 481 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:30:58.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:57.542159+0000 mon.c (mon.1) 272 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-02-17T23:30:58.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:57.542930+0000 mon.c (mon.1) 273 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:30:58.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:30:57.544775+0000 mon.c (mon.1) 274 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "container_image"}]: dispatch 2024-02-17T23:30:59.373 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:30:57.536012+0000 mgr.y (mgr.44106) 256 : cephadm [INF] Upgrade: Updating osd.7 2024-02-17T23:30:59.373 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:30:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:30:57.544307+0000 mgr.y (mgr.44106) 257 : cephadm [INF] Deploying daemon osd.7 on smithi080 2024-02-17T23:30:59.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:30:57.536012+0000 mgr.y (mgr.44106) 256 : cephadm [INF] Upgrade: Updating osd.7 2024-02-17T23:30:59.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:30:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:30:57.544307+0000 mgr.y (mgr.44106) 257 : cephadm [INF] Deploying daemon osd.7 on smithi080 2024-02-17T23:30:59.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:30:57.536012+0000 mgr.y (mgr.44106) 256 : cephadm [INF] Upgrade: Updating osd.7 2024-02-17T23:30:59.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:30:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:30:57.544307+0000 mgr.y (mgr.44106) 257 : cephadm [INF] Deploying daemon osd.7 on smithi080 2024-02-17T23:31:00.458 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:30:58.851784+0000 mgr.y (mgr.44106) 258 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 69 op/s 2024-02-17T23:31:00.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:30:58.851784+0000 mgr.y (mgr.44106) 258 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 69 op/s 2024-02-17T23:31:00.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:30:58.851784+0000 mgr.y (mgr.44106) 258 : cluster [DBG] pgmap v173: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 42 KiB/s rd, 0 B/s wr, 69 op/s 2024-02-17T23:31:00.733 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:00 smithi080 systemd[1]: Stopping Ceph osd.7 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:31:01.100 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:00 smithi080 bash[42871]: debug 2024-02-17T23:31:00.730+0000 7f605cc81700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2024-02-17T23:31:01.100 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:00 smithi080 bash[42871]: debug 2024-02-17T23:31:00.730+0000 7f605cc81700 -1 osd.7 101 *** Got signal Terminated *** 2024-02-17T23:31:01.100 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:00 smithi080 bash[42871]: debug 2024-02-17T23:31:00.730+0000 7f605cc81700 -1 osd.7 101 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:31:01.390 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:01 smithi080 bash[61659]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.7 2024-02-17T23:31:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.978528+0000 mon.a (mon.0) 482 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-17T23:31:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.978563+0000 mon.a (mon.0) 483 : cluster [INF] osd.7 failed (root=default,host=smithi080) (connection refused reported by osd.1) 2024-02-17T23:31:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.978730+0000 mon.a (mon.0) 484 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-17T23:31:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.978779+0000 mon.a (mon.0) 485 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-17T23:31:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.978937+0000 mon.a (mon.0) 486 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-17T23:31:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.979023+0000 mon.a (mon.0) 487 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-17T23:31:01.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.979169+0000 mon.a (mon.0) 488 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-17T23:31:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.979250+0000 mon.a (mon.0) 489 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-17T23:31:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.979410+0000 mon.a (mon.0) 490 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-17T23:31:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.979538+0000 mon.a (mon.0) 491 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-17T23:31:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.979622+0000 mon.a (mon.0) 492 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-17T23:31:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.979829+0000 mon.a (mon.0) 493 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-17T23:31:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.979912+0000 mon.a (mon.0) 494 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-17T23:31:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.980128+0000 mon.a (mon.0) 495 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-17T23:31:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.980296+0000 mon.a (mon.0) 496 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-17T23:31:01.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:01.097173+0000 mon.a (mon.0) 497 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-17T23:31:01.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.978528+0000 mon.a (mon.0) 482 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-17T23:31:01.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.978563+0000 mon.a (mon.0) 483 : cluster [INF] osd.7 failed (root=default,host=smithi080) (connection refused reported by osd.1) 2024-02-17T23:31:01.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.978730+0000 mon.a (mon.0) 484 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-17T23:31:01.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.978779+0000 mon.a (mon.0) 485 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-17T23:31:01.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.978937+0000 mon.a (mon.0) 486 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-17T23:31:01.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.979023+0000 mon.a (mon.0) 487 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-17T23:31:01.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.979169+0000 mon.a (mon.0) 488 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.979250+0000 mon.a (mon.0) 489 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.979410+0000 mon.a (mon.0) 490 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.979538+0000 mon.a (mon.0) 491 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.979622+0000 mon.a (mon.0) 492 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.979829+0000 mon.a (mon.0) 493 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.979912+0000 mon.a (mon.0) 494 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.980128+0000 mon.a (mon.0) 495 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.980296+0000 mon.a (mon.0) 496 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:01.097173+0000 mon.a (mon.0) 497 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.978528+0000 mon.a (mon.0) 482 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.978563+0000 mon.a (mon.0) 483 : cluster [INF] osd.7 failed (root=default,host=smithi080) (connection refused reported by osd.1) 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.978730+0000 mon.a (mon.0) 484 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-17T23:31:01.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.978779+0000 mon.a (mon.0) 485 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.978937+0000 mon.a (mon.0) 486 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.979023+0000 mon.a (mon.0) 487 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.979169+0000 mon.a (mon.0) 488 : cluster [DBG] osd.7 reported immediately failed by osd.3 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.979250+0000 mon.a (mon.0) 489 : cluster [DBG] osd.7 reported immediately failed by osd.0 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.979410+0000 mon.a (mon.0) 490 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.979538+0000 mon.a (mon.0) 491 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.979622+0000 mon.a (mon.0) 492 : cluster [DBG] osd.7 reported immediately failed by osd.4 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.979829+0000 mon.a (mon.0) 493 : cluster [DBG] osd.7 reported immediately failed by osd.2 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.979912+0000 mon.a (mon.0) 494 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.980128+0000 mon.a (mon.0) 495 : cluster [DBG] osd.7 reported immediately failed by osd.6 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.980296+0000 mon.a (mon.0) 496 : cluster [DBG] osd.7 reported immediately failed by osd.5 2024-02-17T23:31:01.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:01.097173+0000 mon.a (mon.0) 497 : cluster [DBG] osd.7 reported immediately failed by osd.1 2024-02-17T23:31:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:00.852457+0000 mgr.y (mgr.44106) 259 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 39 op/s 2024-02-17T23:31:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:01.165997+0000 mon.a (mon.0) 498 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:31:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:01.166021+0000 mon.a (mon.0) 499 : cluster [WRN] Health check failed: all OSDs are running pacific or later but require_osd_release < pacific (OSD_UPGRADE_FINISHED) 2024-02-17T23:31:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:01.174627+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2024-02-17T23:31:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:00.852457+0000 mgr.y (mgr.44106) 259 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 39 op/s 2024-02-17T23:31:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:01.165997+0000 mon.a (mon.0) 498 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:31:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:01.166021+0000 mon.a (mon.0) 499 : cluster [WRN] Health check failed: all OSDs are running pacific or later but require_osd_release < pacific (OSD_UPGRADE_FINISHED) 2024-02-17T23:31:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:01.174627+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2024-02-17T23:31:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:00.852457+0000 mgr.y (mgr.44106) 259 : cluster [DBG] pgmap v174: 129 pgs: 129 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 39 op/s 2024-02-17T23:31:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:01.165997+0000 mon.a (mon.0) 498 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2024-02-17T23:31:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:01.166021+0000 mon.a (mon.0) 499 : cluster [WRN] Health check failed: all OSDs are running pacific or later but require_osd_release < pacific (OSD_UPGRADE_FINISHED) 2024-02-17T23:31:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:01.174627+0000 mon.a (mon.0) 500 : cluster [DBG] osdmap e102: 8 total, 7 up, 8 in 2024-02-17T23:31:03.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:02.176786+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2024-02-17T23:31:03.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:02.176786+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2024-02-17T23:31:03.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:02.176786+0000 mon.a (mon.0) 501 : cluster [DBG] osdmap e103: 8 total, 7 up, 8 in 2024-02-17T23:31:03.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:03 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.7.service: Succeeded. 2024-02-17T23:31:03.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:03 smithi080 systemd[1]: Stopped Ceph osd.7 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:31:03.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:03 smithi080 systemd[1]: Starting Ceph osd.7 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:31:04.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:02.852991+0000 mgr.y (mgr.44106) 260 : cluster [DBG] pgmap v177: 129 pgs: 17 stale+active+clean, 112 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:31:04.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:02.852991+0000 mgr.y (mgr.44106) 260 : cluster [DBG] pgmap v177: 129 pgs: 17 stale+active+clean, 112 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:31:04.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:02.852991+0000 mgr.y (mgr.44106) 260 : cluster [DBG] pgmap v177: 129 pgs: 17 stale+active+clean, 112 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail 2024-02-17T23:31:04.813 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:04 smithi080 bash[61965]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-02-17T23:31:04.813 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:04 smithi080 bash[61965]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-17T23:31:04.813 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:04 smithi080 bash[61965]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2024-02-17T23:31:04.813 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:04 smithi080 bash[61965]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2024-02-17T23:31:04.813 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:04 smithi080 bash[61965]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2024-02-17T23:31:04.813 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:04 smithi080 bash[61965]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2024-02-17T23:31:04.813 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:04 smithi080 bash[61965]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-02-17T23:31:04.813 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:04 smithi080 bash[61965]: --> ceph-volume lvm activate successful for osd ID: 7 2024-02-17T23:31:05.486 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:05.179788+0000 mon.a (mon.0) 502 : cluster [WRN] Health check failed: Degraded data redundancy: 67/606 objects degraded (11.056%), 18 pgs degraded (PG_DEGRADED) 2024-02-17T23:31:05.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:05.179788+0000 mon.a (mon.0) 502 : cluster [WRN] Health check failed: Degraded data redundancy: 67/606 objects degraded (11.056%), 18 pgs degraded (PG_DEGRADED) 2024-02-17T23:31:05.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:05.179788+0000 mon.a (mon.0) 502 : cluster [WRN] Health check failed: Degraded data redundancy: 67/606 objects degraded (11.056%), 18 pgs degraded (PG_DEGRADED) 2024-02-17T23:31:06.140 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:31:05.653+0000 7f51f07e1700 1 -- 172.21.15.80:0/2781174490 <== mon.2 v2:172.21.15.80:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55634d780680 con 0x55634d747000 2024-02-17T23:31:06.140 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:05 smithi080 bash[62234]: eedc239c76831f1643ca32dd8fa00dcf5a3742aeed7e5015e23f84ccb8eb995f 2024-02-17T23:31:06.140 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:05 smithi080 systemd[1]: Started Ceph osd.7 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:31:06.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:04.853919+0000 mgr.y (mgr.44106) 261 : cluster [DBG] pgmap v178: 129 pgs: 18 active+undersized+degraded, 5 stale+active+clean, 20 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:31:06.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:05.785981+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:06.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:05.787471+0000 mon.c (mon.1) 275 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:06.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:05.789376+0000 mon.c (mon.1) 276 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:06.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:04.853919+0000 mgr.y (mgr.44106) 261 : cluster [DBG] pgmap v178: 129 pgs: 18 active+undersized+degraded, 5 stale+active+clean, 20 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:31:06.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:05.785981+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:06.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:05.787471+0000 mon.c (mon.1) 275 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:06.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:05.789376+0000 mon.c (mon.1) 276 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:06.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:31:06.172+0000 7f51f826f380 -1 Falling back to public interface 2024-02-17T23:31:06.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:04.853919+0000 mgr.y (mgr.44106) 261 : cluster [DBG] pgmap v178: 129 pgs: 18 active+undersized+degraded, 5 stale+active+clean, 20 active+undersized, 86 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 67/606 objects degraded (11.056%) 2024-02-17T23:31:06.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:05.785981+0000 mon.a (mon.0) 503 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:06.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:05.787471+0000 mon.c (mon.1) 275 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:06.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:05.789376+0000 mon.c (mon.1) 276 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:08.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:06.854591+0000 mgr.y (mgr.44106) 262 : cluster [DBG] pgmap v179: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:31:08.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:06.854591+0000 mgr.y (mgr.44106) 262 : cluster [DBG] pgmap v179: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:31:08.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:06.854591+0000 mgr.y (mgr.44106) 262 : cluster [DBG] pgmap v179: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:31:09.206 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:31:08.906+0000 7f51f826f380 -1 osd.7 101 log_to_monitors {default=true} 2024-02-17T23:31:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:08.909934+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/709187693,v1:172.21.15.80:6825/709187693]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:31:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:08.910441+0000 mon.a (mon.0) 504 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:31:09.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:08.909934+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/709187693,v1:172.21.15.80:6825/709187693]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:31:09.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:08.910441+0000 mon.a (mon.0) 504 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:31:09.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:31:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:31:09.259+0000 7f51eaf59700 -1 osd.7 101 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-02-17T23:31:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:08.909934+0000 mon.b (mon.2) 9 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/709187693,v1:172.21.15.80:6825/709187693]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:31:09.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:08.910441+0000 mon.a (mon.0) 504 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-02-17T23:31:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:08.855397+0000 mgr.y (mgr.44106) 263 : cluster [DBG] pgmap v180: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:31:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:09.245142+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-17T23:31:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:09.245235+0000 mon.a (mon.0) 506 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2024-02-17T23:31:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:09.249176+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/709187693,v1:172.21.15.80:6825/709187693]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:31:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:09.249687+0000 mon.a (mon.0) 507 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:31:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:08.855397+0000 mgr.y (mgr.44106) 263 : cluster [DBG] pgmap v180: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:31:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:09.245142+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-17T23:31:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:09.245235+0000 mon.a (mon.0) 506 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2024-02-17T23:31:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:09.249176+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/709187693,v1:172.21.15.80:6825/709187693]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:31:10.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:09.249687+0000 mon.a (mon.0) 507 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:31:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:08.855397+0000 mgr.y (mgr.44106) 263 : cluster [DBG] pgmap v180: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 2.0 GiB used, 712 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:31:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:09.245142+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-02-17T23:31:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:09.245235+0000 mon.a (mon.0) 506 : cluster [DBG] osdmap e104: 8 total, 7 up, 8 in 2024-02-17T23:31:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:09.249176+0000 mon.b (mon.2) 10 : audit [INF] from='osd.7 [v2:172.21.15.80:6824/709187693,v1:172.21.15.80:6825/709187693]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:31:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:09.249687+0000 mon.a (mon.0) 507 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi080", "root=default"]}]: dispatch 2024-02-17T23:31:11.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:10.241979+0000 mon.a (mon.0) 508 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:31:11.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:10.246782+0000 mon.a (mon.0) 509 : cluster [INF] osd.7 [v2:172.21.15.80:6824/709187693,v1:172.21.15.80:6825/709187693] boot 2024-02-17T23:31:11.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:10.246838+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-17T23:31:11.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:10.247539+0000 mon.c (mon.1) 277 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:31:11.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:10.747664+0000 mon.a (mon.0) 511 : cluster [WRN] Health check update: Degraded data redundancy: 80/606 objects degraded (13.201%), 26 pgs degraded (PG_DEGRADED) 2024-02-17T23:31:11.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:10.855907+0000 mgr.y (mgr.44106) 264 : cluster [DBG] pgmap v183: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:31:11.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:11.248417+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-17T23:31:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:10.241979+0000 mon.a (mon.0) 508 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:31:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:10.246782+0000 mon.a (mon.0) 509 : cluster [INF] osd.7 [v2:172.21.15.80:6824/709187693,v1:172.21.15.80:6825/709187693] boot 2024-02-17T23:31:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:10.246838+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-17T23:31:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:10.247539+0000 mon.c (mon.1) 277 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:31:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:10.747664+0000 mon.a (mon.0) 511 : cluster [WRN] Health check update: Degraded data redundancy: 80/606 objects degraded (13.201%), 26 pgs degraded (PG_DEGRADED) 2024-02-17T23:31:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:10.855907+0000 mgr.y (mgr.44106) 264 : cluster [DBG] pgmap v183: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:31:11.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:11.248417+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-17T23:31:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:10.241979+0000 mon.a (mon.0) 508 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2024-02-17T23:31:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:10.246782+0000 mon.a (mon.0) 509 : cluster [INF] osd.7 [v2:172.21.15.80:6824/709187693,v1:172.21.15.80:6825/709187693] boot 2024-02-17T23:31:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:10.246838+0000 mon.a (mon.0) 510 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2024-02-17T23:31:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:10.247539+0000 mon.c (mon.1) 277 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-02-17T23:31:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:10.747664+0000 mon.a (mon.0) 511 : cluster [WRN] Health check update: Degraded data redundancy: 80/606 objects degraded (13.201%), 26 pgs degraded (PG_DEGRADED) 2024-02-17T23:31:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:10.855907+0000 mgr.y (mgr.44106) 264 : cluster [DBG] pgmap v183: 129 pgs: 26 active+undersized+degraded, 31 active+undersized, 72 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 80/606 objects degraded (13.201%) 2024-02-17T23:31:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:11.248417+0000 mon.a (mon.0) 512 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2024-02-17T23:31:12.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.270718+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:12.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.558114+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:12.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.564001+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:12.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.567016+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.568553+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.569682+0000 mon.c (mon.1) 281 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.571665+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:11.572352+0000 mgr.y (mgr.44106) 265 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-17T23:31:12.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.576827+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:12.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.577977+0000 mon.c (mon.1) 283 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-17T23:31:12.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.578281+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-17T23:31:12.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.581697+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-17T23:31:12.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.582619+0000 mon.c (mon.1) 284 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-17T23:31:12.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.582919+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-17T23:31:12.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.586057+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-17T23:31:12.628 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.587103+0000 mon.c (mon.1) 285 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-17T23:31:12.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.270718+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:12.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.558114+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.564001+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.567016+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.568553+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.569682+0000 mon.c (mon.1) 281 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.571665+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:11.572352+0000 mgr.y (mgr.44106) 265 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.576827+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.577977+0000 mon.c (mon.1) 283 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.578281+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.581697+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-17T23:31:12.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.582619+0000 mon.c (mon.1) 284 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-17T23:31:12.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.582919+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-17T23:31:12.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.586057+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-17T23:31:12.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.587103+0000 mon.c (mon.1) 285 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-17T23:31:12.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.587386+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-17T23:31:12.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.590520+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-17T23:31:12.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.591503+0000 mon.c (mon.1) 286 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-17T23:31:12.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.591775+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-17T23:31:12.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.594872+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-17T23:31:12.630 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.595994+0000 mon.c (mon.1) 287 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.596303+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.599338+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.600456+0000 mon.c (mon.1) 288 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.600717+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.603861+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.605044+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.605319+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.608323+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.609449+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.609746+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.612721+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-02-17T23:31:12.631 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:11.614393+0000 mgr.y (mgr.44106) 266 : cephadm [INF] Upgrade: Setting require_osd_release to 16 pacific 2024-02-17T23:31:12.632 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.614663+0000 mon.c (mon.1) 291 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-17T23:31:12.632 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:11.614965+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-17T23:31:12.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.587386+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-17T23:31:12.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.590520+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-17T23:31:12.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.591503+0000 mon.c (mon.1) 286 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-17T23:31:12.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.591775+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-17T23:31:12.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.594872+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-17T23:31:12.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.595994+0000 mon.c (mon.1) 287 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-17T23:31:12.632 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.596303+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.599338+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.600456+0000 mon.c (mon.1) 288 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.600717+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.603861+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.605044+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.605319+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.608323+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.609449+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.609746+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.612721+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:11.614393+0000 mgr.y (mgr.44106) 266 : cephadm [INF] Upgrade: Setting require_osd_release to 16 pacific 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.614663+0000 mon.c (mon.1) 291 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-17T23:31:12.633 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:11.614965+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-17T23:31:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.270718+0000 mon.a (mon.0) 513 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.558114+0000 mon.a (mon.0) 514 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.564001+0000 mon.c (mon.1) 278 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.567016+0000 mon.c (mon.1) 279 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.568553+0000 mon.c (mon.1) 280 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.569682+0000 mon.c (mon.1) 281 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.571665+0000 mon.c (mon.1) 282 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:11.572352+0000 mgr.y (mgr.44106) 265 : cephadm [INF] Upgrade: Setting container_image for all osd 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.576827+0000 mon.a (mon.0) 515 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.577977+0000 mon.c (mon.1) 283 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.578281+0000 mon.a (mon.0) 516 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.581697+0000 mon.a (mon.0) 517 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.582619+0000 mon.c (mon.1) 284 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-17T23:31:12.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.582919+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.586057+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.587103+0000 mon.c (mon.1) 285 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.587386+0000 mon.a (mon.0) 520 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.590520+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.591503+0000 mon.c (mon.1) 286 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.591775+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.594872+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.595994+0000 mon.c (mon.1) 287 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.596303+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.599338+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-02-17T23:31:12.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.600456+0000 mon.c (mon.1) 288 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.600717+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.603861+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.605044+0000 mon.c (mon.1) 289 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.605319+0000 mon.a (mon.0) 528 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]: dispatch 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.608323+0000 mon.a (mon.0) 529 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.6"}]': finished 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.609449+0000 mon.c (mon.1) 290 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.609746+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]: dispatch 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.612721+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.7"}]': finished 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:11.614393+0000 mgr.y (mgr.44106) 266 : cephadm [INF] Upgrade: Setting require_osd_release to 16 pacific 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.614663+0000 mon.c (mon.1) 291 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-17T23:31:12.643 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:11.614965+0000 mon.a (mon.0) 532 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd require-osd-release", "release": "pacific"}]: dispatch 2024-02-17T23:31:13.501 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:12.610846+0000 mon.a (mon.0) 533 : cluster [INF] Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running pacific or later but require_osd_release < pacific) 2024-02-17T23:31:13.501 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:12.615614+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "pacific"}]': finished 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:12.615692+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:12.619708+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:12.620833+0000 mgr.y (mgr.44106) 267 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:12.626490+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:12.856332+0000 mgr.y (mgr.44106) 268 : cluster [DBG] pgmap v186: 129 pgs: 11 peering, 21 active+undersized+degraded, 25 active+undersized, 72 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 70/606 objects degraded (11.551%) 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:12.610846+0000 mon.a (mon.0) 533 : cluster [INF] Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running pacific or later but require_osd_release < pacific) 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:12.615614+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "pacific"}]': finished 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:12.615692+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:12.619708+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:12.620833+0000 mgr.y (mgr.44106) 267 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:12.626490+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:13.502 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:12.856332+0000 mgr.y (mgr.44106) 268 : cluster [DBG] pgmap v186: 129 pgs: 11 peering, 21 active+undersized+degraded, 25 active+undersized, 72 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 70/606 objects degraded (11.551%) 2024-02-17T23:31:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:12.610846+0000 mon.a (mon.0) 533 : cluster [INF] Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running pacific or later but require_osd_release < pacific) 2024-02-17T23:31:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:12.615614+0000 mon.a (mon.0) 534 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "osd require-osd-release", "release": "pacific"}]': finished 2024-02-17T23:31:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:12.615692+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2024-02-17T23:31:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:12.619708+0000 mon.c (mon.1) 292 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:12.620833+0000 mgr.y (mgr.44106) 267 : cephadm [INF] Upgrade: Setting container_image for all mds 2024-02-17T23:31:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:12.626490+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:12.856332+0000 mgr.y (mgr.44106) 268 : cluster [DBG] pgmap v186: 129 pgs: 11 peering, 21 active+undersized+degraded, 25 active+undersized, 72 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 70/606 objects degraded (11.551%) 2024-02-17T23:31:15.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:14.443461+0000 mgr.y (mgr.44106) 269 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi005.dlhvju (1/2) 2024-02-17T23:31:15.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:14.448444+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:15.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:14.449420+0000 mon.c (mon.1) 293 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:15.877 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:14.449761+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:15.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:14.451620+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:31:15.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:14.452278+0000 mgr.y (mgr.44106) 270 : cephadm [INF] Deploying daemon rgw.r.z.smithi005.dlhvju on smithi005 2024-02-17T23:31:15.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:14.452697+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi005.dlhvju","key": "container_image"}]: dispatch 2024-02-17T23:31:15.878 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:14.856974+0000 mgr.y (mgr.44106) 271 : cluster [DBG] pgmap v187: 129 pgs: 11 peering, 3 active+undersized, 115 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:15.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:14.443461+0000 mgr.y (mgr.44106) 269 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi005.dlhvju (1/2) 2024-02-17T23:31:15.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:14.448444+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:15.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:14.449420+0000 mon.c (mon.1) 293 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:15.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:14.449761+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:15.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:14.451620+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:31:15.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:14.452278+0000 mgr.y (mgr.44106) 270 : cephadm [INF] Deploying daemon rgw.r.z.smithi005.dlhvju on smithi005 2024-02-17T23:31:15.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:14.452697+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi005.dlhvju","key": "container_image"}]: dispatch 2024-02-17T23:31:15.879 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:14.856974+0000 mgr.y (mgr.44106) 271 : cluster [DBG] pgmap v187: 129 pgs: 11 peering, 3 active+undersized, 115 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:14.443461+0000 mgr.y (mgr.44106) 269 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi005.dlhvju (1/2) 2024-02-17T23:31:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:14.448444+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:14.449420+0000 mon.c (mon.1) 293 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:14.449761+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi005.dlhvju", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:14.451620+0000 mon.c (mon.1) 294 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:31:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:14.452278+0000 mgr.y (mgr.44106) 270 : cephadm [INF] Deploying daemon rgw.r.z.smithi005.dlhvju on smithi005 2024-02-17T23:31:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:14.452697+0000 mon.c (mon.1) 295 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi005.dlhvju","key": "container_image"}]: dispatch 2024-02-17T23:31:15.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:14.856974+0000 mgr.y (mgr.44106) 271 : cluster [DBG] pgmap v187: 129 pgs: 11 peering, 3 active+undersized, 115 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:16.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:15.445520+0000 mon.a (mon.0) 539 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/606 objects degraded (11.551%), 21 pgs degraded) 2024-02-17T23:31:16.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:15.445545+0000 mon.a (mon.0) 540 : cluster [INF] Cluster is now healthy 2024-02-17T23:31:16.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:15.445520+0000 mon.a (mon.0) 539 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/606 objects degraded (11.551%), 21 pgs degraded) 2024-02-17T23:31:16.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:15.445545+0000 mon.a (mon.0) 540 : cluster [INF] Cluster is now healthy 2024-02-17T23:31:16.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:15.445520+0000 mon.a (mon.0) 539 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 70/606 objects degraded (11.551%), 21 pgs degraded) 2024-02-17T23:31:16.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:15.445545+0000 mon.a (mon.0) 540 : cluster [INF] Cluster is now healthy 2024-02-17T23:31:17.726 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:16.857490+0000 mgr.y (mgr.44106) 272 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:17.727 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:16.857490+0000 mgr.y (mgr.44106) 272 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:17.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:16.857490+0000 mgr.y (mgr.44106) 272 : cluster [DBG] pgmap v188: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:19.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:18.545234+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:19.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:18.858004+0000 mgr.y (mgr.44106) 273 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:19.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:18.545234+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:19.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:18.858004+0000 mgr.y (mgr.44106) 273 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:19.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:18.545234+0000 mon.a (mon.0) 541 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:19.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:18.858004+0000 mgr.y (mgr.44106) 273 : cluster [DBG] pgmap v189: 129 pgs: 129 active+clean; 7.0 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:21.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:20.098622+0000 mgr.y (mgr.44106) 274 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi080.qdwuig (2/2) 2024-02-17T23:31:21.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:20.104069+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:21.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:20.105162+0000 mon.c (mon.1) 296 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:21.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:20.105530+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:21.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:20.107726+0000 mon.c (mon.1) 297 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:31:21.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:20.108484+0000 mgr.y (mgr.44106) 275 : cephadm [INF] Deploying daemon rgw.r.z.smithi080.qdwuig on smithi080 2024-02-17T23:31:21.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:20.109001+0000 mon.c (mon.1) 298 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi080.qdwuig","key": "container_image"}]: dispatch 2024-02-17T23:31:21.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:20.098622+0000 mgr.y (mgr.44106) 274 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi080.qdwuig (2/2) 2024-02-17T23:31:21.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:20.104069+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:21.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:20.105162+0000 mon.c (mon.1) 296 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:21.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:20.105530+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:21.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:20.107726+0000 mon.c (mon.1) 297 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:31:21.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:20.108484+0000 mgr.y (mgr.44106) 275 : cephadm [INF] Deploying daemon rgw.r.z.smithi080.qdwuig on smithi080 2024-02-17T23:31:21.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:20.109001+0000 mon.c (mon.1) 298 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi080.qdwuig","key": "container_image"}]: dispatch 2024-02-17T23:31:21.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:20.098622+0000 mgr.y (mgr.44106) 274 : cephadm [INF] Upgrade: Updating rgw.r.z.smithi080.qdwuig (2/2) 2024-02-17T23:31:21.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:20.104069+0000 mon.a (mon.0) 542 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:21.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:20.105162+0000 mon.c (mon.1) 296 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:21.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:20.105530+0000 mon.a (mon.0) 543 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.r.z.smithi080.qdwuig", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-02-17T23:31:21.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:20.107726+0000 mon.c (mon.1) 297 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-02-17T23:31:21.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:20.108484+0000 mgr.y (mgr.44106) 275 : cephadm [INF] Deploying daemon rgw.r.z.smithi080.qdwuig on smithi080 2024-02-17T23:31:21.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:20.109001+0000 mon.c (mon.1) 298 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "client.rgw.r.z.smithi080.qdwuig","key": "container_image"}]: dispatch 2024-02-17T23:31:22.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:20.858579+0000 mgr.y (mgr.44106) 276 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.1 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 27 KiB/s rd, 106 B/s wr, 42 op/s 2024-02-17T23:31:22.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:20.858579+0000 mgr.y (mgr.44106) 276 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.1 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 27 KiB/s rd, 106 B/s wr, 42 op/s 2024-02-17T23:31:22.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:20.858579+0000 mgr.y (mgr.44106) 276 : cluster [DBG] pgmap v190: 129 pgs: 129 active+clean; 7.1 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 27 KiB/s rd, 106 B/s wr, 42 op/s 2024-02-17T23:31:23.161 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:31:23.822 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:31:23.822 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (6m) 2m ago 12m 24.6M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:31:23.822 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (11m) 12s ago 11m 34.6M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:31:23.822 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (5m) 12s ago 15m 384M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:31:23.822 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (5m) 2m ago 17m 423M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (5m) 2m ago 17m 54.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (4m) 12s ago 15m 60.9M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (4m) 2m ago 16m 49.8M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (12m) 2m ago 12m 12.6M - 1.7.0 72c9c2088986 f95c680110b8 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (12m) 12s ago 12m 13.4M - 1.7.0 72c9c2088986 b8a0e0cba51e 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (3m) 2m ago 15m 41.2M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (3m) 2m ago 15m 39.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (2m) 2m ago 14m 36.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 f9b5c6109867 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (2m) 2m ago 14m 13.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 050f8c4e76bc 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (109s) 12s ago 14m 41.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 e57f1f319143 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (79s) 12s ago 13m 40.3M 4096M 16.2.14-548-g81bd20d6 823b921721f5 c515261f8fad 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (48s) 12s ago 13m 38.9M 4096M 16.2.14-548-g81bd20d6 823b921721f5 041e8ef3bef5 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (18s) 12s ago 13m 13.0M 4096M 16.2.14-548-g81bd20d6 823b921721f5 eedc239c7683 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (6m) 12s ago 12m 47.8M - 2.49.1 2a72b385beaf 10249a176bf4 2024-02-17T23:31:23.823 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 starting - - - - 2024-02-17T23:31:23.824 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (10m) 12s ago 10m 40.3M - 15.2.0 204a01f9b0b6 0b872ec67795 2024-02-17T23:31:24.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:22.859120+0000 mgr.y (mgr.44106) 277 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 45 KiB/s rd, 299 B/s wr, 69 op/s 2024-02-17T23:31:24.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.147930+0000 mgr.y (mgr.44106) 278 : audit [DBG] from='client.54400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:24.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.811026+0000 mon.c (mon.1) 299 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:24.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.811470+0000 mon.c (mon.1) 300 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:24.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.811814+0000 mon.c (mon.1) 301 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.812183+0000 mon.c (mon.1) 302 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.812536+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.141 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.812873+0000 mon.c (mon.1) 304 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.814579+0000 mon.c (mon.1) 305 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:24.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.814896+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.815236+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.815563+0000 mon.c (mon.1) 308 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.815884+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.949780+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:24.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.951346+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:24.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.952834+0000 mon.c (mon.1) 311 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:24.142 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.953146+0000 mon.c (mon.1) 312 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:24.293 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:31:24.293 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:31:24.293 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:31:24.293 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 8 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 1 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 14 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:31:24.294 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:31:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:22.859120+0000 mgr.y (mgr.44106) 277 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 45 KiB/s rd, 299 B/s wr, 69 op/s 2024-02-17T23:31:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.147930+0000 mgr.y (mgr.44106) 278 : audit [DBG] from='client.54400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.811026+0000 mon.c (mon.1) 299 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.811470+0000 mon.c (mon.1) 300 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.811814+0000 mon.c (mon.1) 301 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.812183+0000 mon.c (mon.1) 302 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.812536+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.812873+0000 mon.c (mon.1) 304 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.814579+0000 mon.c (mon.1) 305 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.814896+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.815236+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.815563+0000 mon.c (mon.1) 308 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.815884+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.949780+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:22.859120+0000 mgr.y (mgr.44106) 277 : cluster [DBG] pgmap v191: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 45 KiB/s rd, 299 B/s wr, 69 op/s 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.147930+0000 mgr.y (mgr.44106) 278 : audit [DBG] from='client.54400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.811026+0000 mon.c (mon.1) 299 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.811470+0000 mon.c (mon.1) 300 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.811814+0000 mon.c (mon.1) 301 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.812183+0000 mon.c (mon.1) 302 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.812536+0000 mon.c (mon.1) 303 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.812873+0000 mon.c (mon.1) 304 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.814579+0000 mon.c (mon.1) 305 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.814896+0000 mon.c (mon.1) 306 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.815236+0000 mon.c (mon.1) 307 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.815563+0000 mon.c (mon.1) 308 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.815884+0000 mon.c (mon.1) 309 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.949780+0000 mon.a (mon.0) 544 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.951346+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.952834+0000 mon.c (mon.1) 311 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:24.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.953146+0000 mon.c (mon.1) 312 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:24.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.951346+0000 mon.c (mon.1) 310 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:24.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.952834+0000 mon.c (mon.1) 311 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:24.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.953146+0000 mon.c (mon.1) 312 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:24.630 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: "osd", 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: "mon" 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "13/20 daemons upgraded", 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading rgw daemons", 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:31:24.631 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:31:25.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.475877+0000 mgr.y (mgr.44106) 279 : audit [DBG] from='client.44451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:25.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:23.809256+0000 mgr.y (mgr.44106) 280 : audit [DBG] from='client.54412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:25.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:24.160264+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:25.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:24.291704+0000 mon.a (mon.0) 546 : audit [DBG] from='client.? 172.21.15.5:0/3775416076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:25.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.475877+0000 mgr.y (mgr.44106) 279 : audit [DBG] from='client.44451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:25.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:23.809256+0000 mgr.y (mgr.44106) 280 : audit [DBG] from='client.54412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:25.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:24.160264+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:25.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:24.291704+0000 mon.a (mon.0) 546 : audit [DBG] from='client.? 172.21.15.5:0/3775416076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:25.630 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.475877+0000 mgr.y (mgr.44106) 279 : audit [DBG] from='client.44451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:25.631 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:23.809256+0000 mgr.y (mgr.44106) 280 : audit [DBG] from='client.54412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:25.631 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:24.160264+0000 mon.a (mon.0) 545 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:25.631 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:24.291704+0000 mon.a (mon.0) 546 : audit [DBG] from='client.? 172.21.15.5:0/3775416076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:26.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:24.629125+0000 mgr.y (mgr.44106) 281 : audit [DBG] from='client.54442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:26.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:24.859675+0000 mgr.y (mgr.44106) 282 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 73 KiB/s rd, 255 B/s wr, 112 op/s 2024-02-17T23:31:26.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:24.629125+0000 mgr.y (mgr.44106) 281 : audit [DBG] from='client.54442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:26.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:24.859675+0000 mgr.y (mgr.44106) 282 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 73 KiB/s rd, 255 B/s wr, 112 op/s 2024-02-17T23:31:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:24.629125+0000 mgr.y (mgr.44106) 281 : audit [DBG] from='client.54442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:24.859675+0000 mgr.y (mgr.44106) 282 : cluster [DBG] pgmap v192: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 73 KiB/s rd, 255 B/s wr, 112 op/s 2024-02-17T23:31:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:26.860422+0000 mgr.y (mgr.44106) 283 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 89 KiB/s rd, 341 B/s wr, 138 op/s 2024-02-17T23:31:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:27.270951+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.079055+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.084665+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.092337+0000 mon.c (mon.1) 313 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.095363+0000 mon.c (mon.1) 314 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.096938+0000 mon.c (mon.1) 315 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.098137+0000 mon.c (mon.1) 316 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.100125+0000 mon.c (mon.1) 317 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.101842+0000 mon.c (mon.1) 318 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.103246+0000 mon.c (mon.1) 319 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.108650+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.109588+0000 mon.c (mon.1) 320 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi005.dlhvju"}]: dispatch 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.109920+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi005.dlhvju"}]: dispatch 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.113421+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi005.dlhvju"}]': finished 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.114248+0000 mon.c (mon.1) 321 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi080.qdwuig"}]: dispatch 2024-02-17T23:31:28.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:26.860422+0000 mgr.y (mgr.44106) 283 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 89 KiB/s rd, 341 B/s wr, 138 op/s 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:27.270951+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.079055+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.084665+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.092337+0000 mon.c (mon.1) 313 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.095363+0000 mon.c (mon.1) 314 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.096938+0000 mon.c (mon.1) 315 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.098137+0000 mon.c (mon.1) 316 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.100125+0000 mon.c (mon.1) 317 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.101842+0000 mon.c (mon.1) 318 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.103246+0000 mon.c (mon.1) 319 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.108650+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.109588+0000 mon.c (mon.1) 320 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi005.dlhvju"}]: dispatch 2024-02-17T23:31:28.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.109920+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi005.dlhvju"}]: dispatch 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.113421+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi005.dlhvju"}]': finished 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.114248+0000 mon.c (mon.1) 321 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi080.qdwuig"}]: dispatch 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.114559+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi080.qdwuig"}]: dispatch 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.118008+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi080.qdwuig"}]': finished 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.119237+0000 mon.c (mon.1) 322 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.123805+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.125000+0000 mon.c (mon.1) 323 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.126112+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.130741+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.131969+0000 mon.c (mon.1) 325 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.629 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.136238+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.114559+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi080.qdwuig"}]: dispatch 2024-02-17T23:31:28.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.118008+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi080.qdwuig"}]': finished 2024-02-17T23:31:28.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.119237+0000 mon.c (mon.1) 322 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.123805+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.125000+0000 mon.c (mon.1) 323 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.126112+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.130741+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.131969+0000 mon.c (mon.1) 325 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.630 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.136238+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:26.860422+0000 mgr.y (mgr.44106) 283 : cluster [DBG] pgmap v193: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 89 KiB/s rd, 341 B/s wr, 138 op/s 2024-02-17T23:31:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:27.270951+0000 mon.a (mon.0) 547 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.079055+0000 mon.a (mon.0) 548 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.084665+0000 mon.a (mon.0) 549 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.092337+0000 mon.c (mon.1) 313 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.095363+0000 mon.c (mon.1) 314 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.096938+0000 mon.c (mon.1) 315 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.098137+0000 mon.c (mon.1) 316 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.100125+0000 mon.c (mon.1) 317 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.101842+0000 mon.c (mon.1) 318 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.103246+0000 mon.c (mon.1) 319 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.108650+0000 mon.a (mon.0) 550 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.109588+0000 mon.c (mon.1) 320 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi005.dlhvju"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.109920+0000 mon.a (mon.0) 551 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi005.dlhvju"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.113421+0000 mon.a (mon.0) 552 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi005.dlhvju"}]': finished 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.114248+0000 mon.c (mon.1) 321 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi080.qdwuig"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.114559+0000 mon.a (mon.0) 553 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi080.qdwuig"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.118008+0000 mon.a (mon.0) 554 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw.r.z.smithi080.qdwuig"}]': finished 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.119237+0000 mon.c (mon.1) 322 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.123805+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.125000+0000 mon.c (mon.1) 323 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.126112+0000 mon.c (mon.1) 324 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.130741+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:28.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.131969+0000 mon.c (mon.1) 325 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:28.642 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.136238+0000 mon.a (mon.0) 557 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:28.103928+0000 mgr.y (mgr.44106) 284 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-17T23:31:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:28.119915+0000 mgr.y (mgr.44106) 285 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-17T23:31:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:28.126733+0000 mgr.y (mgr.44106) 286 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-17T23:31:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:28.132642+0000 mgr.y (mgr.44106) 287 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.829933+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.830144+0000 mon.c (mon.1) 327 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.830301+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.830346+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.830454+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.830894+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.831158+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:28.831425+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:28.103928+0000 mgr.y (mgr.44106) 284 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:28.119915+0000 mgr.y (mgr.44106) 285 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-17T23:31:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:28.126733+0000 mgr.y (mgr.44106) 286 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-17T23:31:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:28.132642+0000 mgr.y (mgr.44106) 287 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-17T23:31:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.829933+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:31:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.830144+0000 mon.c (mon.1) 327 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.830301+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.830346+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:31:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.830454+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:31:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.830894+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.831158+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:28.831425+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:31:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:28.103928+0000 mgr.y (mgr.44106) 284 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-02-17T23:31:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:28.119915+0000 mgr.y (mgr.44106) 285 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-02-17T23:31:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:28.126733+0000 mgr.y (mgr.44106) 286 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-02-17T23:31:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:28.132642+0000 mgr.y (mgr.44106) 287 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-02-17T23:31:29.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.829933+0000 mon.c (mon.1) 326 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:31:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.830144+0000 mon.c (mon.1) 327 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.830301+0000 mon.c (mon.1) 328 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.830346+0000 mon.a (mon.0) 558 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [7, 2]}]: dispatch 2024-02-17T23:31:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.830454+0000 mon.c (mon.1) 329 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:31:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.830894+0000 mon.a (mon.0) 559 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.2", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.831158+0000 mon.a (mon.0) 560 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 2]}]: dispatch 2024-02-17T23:31:29.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:28.831425+0000 mon.a (mon.0) 561 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:31:30.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:28.860840+0000 mgr.y (mgr.44106) 288 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 105 KiB/s rd, 341 B/s wr, 163 op/s 2024-02-17T23:31:30.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:28.860840+0000 mgr.y (mgr.44106) 288 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 105 KiB/s rd, 341 B/s wr, 163 op/s 2024-02-17T23:31:30.377 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:30 smithi005 systemd[1]: Stopping Ceph node-exporter.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:31:30.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:30 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:28.860840+0000 mgr.y (mgr.44106) 288 : cluster [DBG] pgmap v194: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 105 KiB/s rd, 341 B/s wr, 163 op/s 2024-02-17T23:31:31.177 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:30 smithi005 bash[72800]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter.a 2024-02-17T23:31:31.177 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:31 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=2/INVALIDARGUMENT 2024-02-17T23:31:31.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:29.696559+0000 mgr.y (mgr.44106) 289 : cephadm [INF] Upgrade: Updating node-exporter.a (1/2) 2024-02-17T23:31:31.509 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:29.696731+0000 mgr.y (mgr.44106) 290 : cephadm [INF] Deploying daemon node-exporter.a on smithi005 2024-02-17T23:31:31.509 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:29.696559+0000 mgr.y (mgr.44106) 289 : cephadm [INF] Upgrade: Updating node-exporter.a (1/2) 2024-02-17T23:31:31.509 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:29.696731+0000 mgr.y (mgr.44106) 290 : cephadm [INF] Deploying daemon node-exporter.a on smithi005 2024-02-17T23:31:31.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:29.696559+0000 mgr.y (mgr.44106) 289 : cephadm [INF] Upgrade: Updating node-exporter.a (1/2) 2024-02-17T23:31:31.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:29.696731+0000 mgr.y (mgr.44106) 290 : cephadm [INF] Deploying daemon node-exporter.a on smithi005 2024-02-17T23:31:31.851 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:31 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-17T23:31:31.852 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:31 smithi005 systemd[1]: Stopped Ceph node-exporter.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:31:31.852 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:31 smithi005 systemd[1]: Starting Ceph node-exporter.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:31:32.126 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:31 smithi005 bash[72982]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-02-17T23:31:32.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:30.861456+0000 mgr.y (mgr.44106) 291 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 108 KiB/s rd, 341 B/s wr, 167 op/s 2024-02-17T23:31:32.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:30.861456+0000 mgr.y (mgr.44106) 291 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 108 KiB/s rd, 341 B/s wr, 167 op/s 2024-02-17T23:31:32.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:32 smithi005 bash[72982]: Getting image source signatures 2024-02-17T23:31:32.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:32 smithi005 bash[72982]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-02-17T23:31:32.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:32 smithi005 bash[72982]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-02-17T23:31:32.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:32 smithi005 bash[72982]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-02-17T23:31:32.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:30.861456+0000 mgr.y (mgr.44106) 291 : cluster [DBG] pgmap v195: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 108 KiB/s rd, 341 B/s wr, 167 op/s 2024-02-17T23:31:33.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:33 smithi005 bash[72982]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-02-17T23:31:33.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:33 smithi005 bash[72982]: Writing manifest to image destination 2024-02-17T23:31:34.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:32.862017+0000 mgr.y (mgr.44106) 292 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 87 KiB/s rd, 255 B/s wr, 133 op/s 2024-02-17T23:31:34.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:32.862017+0000 mgr.y (mgr.44106) 292 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 87 KiB/s rd, 255 B/s wr, 133 op/s 2024-02-17T23:31:34.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.158Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-02-17T23:31:34.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.158Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-02-17T23:31:34.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-02-17T23:31:34.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-17T23:31:34.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-02-17T23:31:34.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=arp 2024-02-17T23:31:34.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=bcache 2024-02-17T23:31:34.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=bonding 2024-02-17T23:31:34.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=btrfs 2024-02-17T23:31:34.627 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=conntrack 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=cpu 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=diskstats 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=dmi 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=edac 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=entropy 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=filefd 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=filesystem 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=hwmon 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=infiniband 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=ipvs 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=loadavg 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=mdadm 2024-02-17T23:31:34.628 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=meminfo 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=netclass 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=netdev 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=netstat 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=nfs 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=nfsd 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=nvme 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=os 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=pressure 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=rapl 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=schedstat 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=sockstat 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=softnet 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=stat 2024-02-17T23:31:34.629 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=tapestats 2024-02-17T23:31:34.630 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=textfile 2024-02-17T23:31:34.630 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-02-17T23:31:34.630 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=time 2024-02-17T23:31:34.630 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-02-17T23:31:34.630 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=uname 2024-02-17T23:31:34.630 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=vmstat 2024-02-17T23:31:34.630 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=xfs 2024-02-17T23:31:34.630 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:115 level=info collector=zfs 2024-02-17T23:31:34.630 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.159Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-02-17T23:31:34.631 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a[73008]: ts=2024-02-17T23:31:34.160Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-02-17T23:31:34.631 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 bash[72982]: 40fcddf1502da5cd052122ed3c27b8fed5a63c309fd20ce6dd2cf46e69b90ea8 2024-02-17T23:31:34.631 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:31:34 smithi005 systemd[1]: Started Ceph node-exporter.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:31:34.639 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:32.862017+0000 mgr.y (mgr.44106) 292 : cluster [DBG] pgmap v196: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 87 KiB/s rd, 255 B/s wr, 133 op/s 2024-02-17T23:31:35.480 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:34.315016+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:35.481 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:34.862849+0000 mgr.y (mgr.44106) 293 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 70 KiB/s rd, 85 B/s wr, 108 op/s 2024-02-17T23:31:35.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:34.315016+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:35.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:34.862849+0000 mgr.y (mgr.44106) 293 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 70 KiB/s rd, 85 B/s wr, 108 op/s 2024-02-17T23:31:35.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:34.315016+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:35.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:34.862849+0000 mgr.y (mgr.44106) 293 : cluster [DBG] pgmap v197: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 70 KiB/s rd, 85 B/s wr, 108 op/s 2024-02-17T23:31:36.608 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:35.835358+0000 mgr.y (mgr.44106) 294 : cephadm [INF] Upgrade: Updating node-exporter.b (2/2) 2024-02-17T23:31:36.608 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:35.835549+0000 mgr.y (mgr.44106) 295 : cephadm [INF] Deploying daemon node-exporter.b on smithi080 2024-02-17T23:31:36.608 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:36 smithi080 systemd[1]: Stopping Ceph node-exporter.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:31:36.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:35.835358+0000 mgr.y (mgr.44106) 294 : cephadm [INF] Upgrade: Updating node-exporter.b (2/2) 2024-02-17T23:31:36.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:35.835549+0000 mgr.y (mgr.44106) 295 : cephadm [INF] Deploying daemon node-exporter.b on smithi080 2024-02-17T23:31:36.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:35.835358+0000 mgr.y (mgr.44106) 294 : cephadm [INF] Upgrade: Updating node-exporter.b (2/2) 2024-02-17T23:31:36.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:35.835549+0000 mgr.y (mgr.44106) 295 : cephadm [INF] Deploying daemon node-exporter.b on smithi080 2024-02-17T23:31:36.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:36 smithi080 bash[64840]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter.b 2024-02-17T23:31:37.334 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:36 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=2/INVALIDARGUMENT 2024-02-17T23:31:37.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:36.863426+0000 mgr.y (mgr.44106) 296 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 36 KiB/s rd, 85 B/s wr, 55 op/s 2024-02-17T23:31:37.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:36.863426+0000 mgr.y (mgr.44106) 296 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 36 KiB/s rd, 85 B/s wr, 55 op/s 2024-02-17T23:31:37.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:36.863426+0000 mgr.y (mgr.44106) 296 : cluster [DBG] pgmap v198: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 36 KiB/s rd, 85 B/s wr, 55 op/s 2024-02-17T23:31:37.640 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:37 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-17T23:31:37.640 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:37 smithi080 systemd[1]: Stopped Ceph node-exporter.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:31:37.641 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:37 smithi080 systemd[1]: Starting Ceph node-exporter.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:31:38.140 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:37 smithi080 bash[65024]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-02-17T23:31:38.640 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:38 smithi080 bash[65024]: Getting image source signatures 2024-02-17T23:31:38.640 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:38 smithi080 bash[65024]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-02-17T23:31:38.640 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:38 smithi080 bash[65024]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-02-17T23:31:38.640 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:38 smithi080 bash[65024]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-02-17T23:31:40.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:38.864097+0000 mgr.y (mgr.44106) 297 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-02-17T23:31:40.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:38.864097+0000 mgr.y (mgr.44106) 297 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-02-17T23:31:40.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:38.864097+0000 mgr.y (mgr.44106) 297 : cluster [DBG] pgmap v199: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 29 op/s 2024-02-17T23:31:40.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:40 smithi080 bash[65024]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-02-17T23:31:40.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:40 smithi080 bash[65024]: Writing manifest to image destination 2024-02-17T23:31:41.572 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.497Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-02-17T23:31:41.572 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.497Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-02-17T23:31:41.573 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-02-17T23:31:41.573 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-02-17T23:31:41.573 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-02-17T23:31:41.573 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=arp 2024-02-17T23:31:41.573 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=bcache 2024-02-17T23:31:41.573 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=bonding 2024-02-17T23:31:41.573 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=btrfs 2024-02-17T23:31:41.573 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=conntrack 2024-02-17T23:31:41.573 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=cpu 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=diskstats 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=dmi 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=edac 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=entropy 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=filefd 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=filesystem 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=hwmon 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=infiniband 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=ipvs 2024-02-17T23:31:41.574 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=loadavg 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=mdadm 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=meminfo 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=netclass 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=netdev 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=netstat 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=nfs 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=nfsd 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=nvme 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=os 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=pressure 2024-02-17T23:31:41.575 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=rapl 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=schedstat 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=sockstat 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=softnet 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=stat 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=tapestats 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=textfile 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=time 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=uname 2024-02-17T23:31:41.576 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=vmstat 2024-02-17T23:31:41.577 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=xfs 2024-02-17T23:31:41.577 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:115 level=info collector=zfs 2024-02-17T23:31:41.577 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.498Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-02-17T23:31:41.577 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b[65074]: ts=2024-02-17T23:31:41.499Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-02-17T23:31:41.577 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 bash[65024]: 60d93e84a643f572453d89caf3eae3dc794ea8313e29e74a2e7e4925f18fb9af 2024-02-17T23:31:41.890 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:31:41 smithi080 systemd[1]: Started Ceph node-exporter.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:31:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:40.864871+0000 mgr.y (mgr.44106) 298 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-17T23:31:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:41.626787+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:41.628310+0000 mon.c (mon.1) 330 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:41.630157+0000 mon.c (mon.1) 331 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:41.630440+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:42.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:40.864871+0000 mgr.y (mgr.44106) 298 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-17T23:31:42.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:41.626787+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:42.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:41.628310+0000 mon.c (mon.1) 330 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:42.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:41.630157+0000 mon.c (mon.1) 331 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:42.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:41.630440+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:40.864871+0000 mgr.y (mgr.44106) 298 : cluster [DBG] pgmap v200: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.0 KiB/s rd, 0 B/s wr, 4 op/s 2024-02-17T23:31:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:41.626787+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:41.628310+0000 mon.c (mon.1) 330 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:41.630157+0000 mon.c (mon.1) 331 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:41.630440+0000 mon.c (mon.1) 332 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:44.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:42.865394+0000 mgr.y (mgr.44106) 299 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:44.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:42.865394+0000 mgr.y (mgr.44106) 299 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:44.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:42.865394+0000 mgr.y (mgr.44106) 299 : cluster [DBG] pgmap v201: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:45.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:44.691775+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:45.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:44.865947+0000 mgr.y (mgr.44106) 300 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:44.691775+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:46.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:44.865947+0000 mgr.y (mgr.44106) 300 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:44.691775+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:46.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:44.865947+0000 mgr.y (mgr.44106) 300 : cluster [DBG] pgmap v202: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:31:46.871 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:45.782704+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:46.871 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:45.787007+0000 mgr.y (mgr.44106) 301 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-17T23:31:46.871 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.058366+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:46.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.064359+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:46.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.069436+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:46.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.076185+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:46.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.078941+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:46.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.080263+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:46.872 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.081189+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:46.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.082734+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:46.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.084126+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:46.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.085270+0000 mon.c (mon.1) 339 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:46.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.086173+0000 mon.c (mon.1) 340 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:46.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.087034+0000 mon.c (mon.1) 341 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:46.873 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.087911+0000 mon.c (mon.1) 342 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:46.874 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.088777+0000 mon.c (mon.1) 343 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:46.874 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:46.089951+0000 mon.c (mon.1) 344 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:45.782704+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:45.787007+0000 mgr.y (mgr.44106) 301 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-17T23:31:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.058366+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.064359+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.069436+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:47.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.076185+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.078941+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.080263+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.081189+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.082734+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.084126+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.085270+0000 mon.c (mon.1) 339 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.086173+0000 mon.c (mon.1) 340 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.087034+0000 mon.c (mon.1) 341 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.087911+0000 mon.c (mon.1) 342 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.088777+0000 mon.c (mon.1) 343 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:46.089951+0000 mon.c (mon.1) 344 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:45.782704+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:47.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:45.787007+0000 mgr.y (mgr.44106) 301 : cephadm [INF] Checking dashboard <-> RGW credentials 2024-02-17T23:31:47.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.058366+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:47.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.064359+0000 mon.a (mon.0) 567 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:47.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.069436+0000 mon.a (mon.0) 568 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:47.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.076185+0000 mon.c (mon.1) 333 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:47.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.078941+0000 mon.c (mon.1) 334 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.080263+0000 mon.c (mon.1) 335 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.128 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.081189+0000 mon.c (mon.1) 336 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.082734+0000 mon.c (mon.1) 337 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.084126+0000 mon.c (mon.1) 338 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.085270+0000 mon.c (mon.1) 339 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.086173+0000 mon.c (mon.1) 340 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.087034+0000 mon.c (mon.1) 341 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.087911+0000 mon.c (mon.1) 342 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.088777+0000 mon.c (mon.1) 343 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:47.129 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:46.089951+0000 mon.c (mon.1) 344 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:48.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:46.866690+0000 mgr.y (mgr.44106) 302 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-02-17T23:31:48.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:46.866690+0000 mgr.y (mgr.44106) 302 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-02-17T23:31:48.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:46.866690+0000 mgr.y (mgr.44106) 302 : cluster [DBG] pgmap v203: 129 pgs: 129 active+clean; 7.2 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-02-17T23:31:49.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:47.714920+0000 mgr.y (mgr.44106) 303 : cephadm [INF] Upgrade: Updating prometheus.a 2024-02-17T23:31:49.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:47.727599+0000 mgr.y (mgr.44106) 304 : cephadm [INF] Deploying daemon prometheus.a on smithi080 2024-02-17T23:31:49.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:47.714920+0000 mgr.y (mgr.44106) 303 : cephadm [INF] Upgrade: Updating prometheus.a 2024-02-17T23:31:49.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:47.727599+0000 mgr.y (mgr.44106) 304 : cephadm [INF] Deploying daemon prometheus.a on smithi080 2024-02-17T23:31:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:47.714920+0000 mgr.y (mgr.44106) 303 : cephadm [INF] Upgrade: Updating prometheus.a 2024-02-17T23:31:49.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:47.727599+0000 mgr.y (mgr.44106) 304 : cephadm [INF] Deploying daemon prometheus.a on smithi080 2024-02-17T23:31:49.890 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:49 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:48.867295+0000 mgr.y (mgr.44106) 305 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-02-17T23:31:50.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:48.867295+0000 mgr.y (mgr.44106) 305 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-02-17T23:31:50.127 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:48.867295+0000 mgr.y (mgr.44106) 305 : cluster [DBG] pgmap v204: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 2.3 KiB/s rd, 170 B/s wr, 2 op/s 2024-02-17T23:31:51.532 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 systemd[1]: Stopping Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:31:51.532 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.528Z caller=main.go:874 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-17T23:31:51.532 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.528Z caller=main.go:898 level=info msg="Stopping scrape discovery manager..." 2024-02-17T23:31:51.532 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.528Z caller=main.go:912 level=info msg="Stopping notify discovery manager..." 2024-02-17T23:31:51.532 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.528Z caller=manager.go:160 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-17T23:31:51.533 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.529Z caller=manager.go:170 level=info component="rule manager" msg="Rule manager stopped" 2024-02-17T23:31:51.533 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.529Z caller=main.go:949 level=info msg="Stopping scrape manager..." 2024-02-17T23:31:51.533 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.529Z caller=main.go:894 level=info msg="Scrape discovery manager stopped" 2024-02-17T23:31:51.533 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.529Z caller=main.go:908 level=info msg="Notify discovery manager stopped" 2024-02-17T23:31:51.533 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.529Z caller=main.go:941 level=info msg="Scrape manager stopped" 2024-02-17T23:31:51.533 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.530Z caller=notifier.go:604 level=info component=notifier msg="Stopping notification manager..." 2024-02-17T23:31:51.533 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.530Z caller=main.go:1171 level=info msg="Notifier manager stopped" 2024-02-17T23:31:51.533 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:51 smithi080 bash[50621]: ts=2024-02-17T23:31:51.530Z caller=main.go:1183 level=info msg="See you next time!" 2024-02-17T23:31:52.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:50.867794+0000 mgr.y (mgr.44106) 306 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:52.140 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:52 smithi080 bash[65898]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus.a 2024-02-17T23:31:52.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:51 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:50.867794+0000 mgr.y (mgr.44106) 306 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:52.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:51 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:50.867794+0000 mgr.y (mgr.44106) 306 : cluster [DBG] pgmap v205: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:52.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:52 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@prometheus.a.service: Succeeded. 2024-02-17T23:31:52.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:52 smithi080 systemd[1]: Stopped Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:31:52.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:52 smithi080 systemd[1]: Starting Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:31:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.367Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-02-17T23:31:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.367Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-02-17T23:31:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.367Z caller=main.go:518 level=info host_details="(Linux 4.18.0-539.el8.x86_64 #1 SMP Mon Feb 5 18:34:56 UTC 2024 x86_64 smithi080 (none))" 2024-02-17T23:31:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.367Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-02-17T23:31:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.367Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-02-17T23:31:53.640 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.368Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.368Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.369Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.372Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.373Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=694.602µs 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.373Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.373Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 bash[66082]: 9f6c7049fa287618e6cae9fa2518d975710549da1b050ea8ed62d17bb4d107e9 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 systemd[1]: Started Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.542Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.562Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.563Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.563Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=37.1µs wal_replay_duration=189.960926ms total_replay_duration=190.710124ms 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.564Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.564Z caller=main.go:947 level=info msg="TSDB started" 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.565Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-02-17T23:31:53.641 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.579Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=14.00433ms db_storage=689ns remote_storage=1.09µs web_handler=526ns query_engine=686ns scrape=474.057µs scrape_sd=23.305µs notify=28.849µs notify_sd=9.047µs rules=13.229285ms 2024-02-17T23:31:53.642 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:31:53.579Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-02-17T23:31:54.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:52.868490+0000 mgr.y (mgr.44106) 307 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:54.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:53.468566+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:54.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:53.470070+0000 mon.c (mon.1) 345 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:54.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:53.472031+0000 mon.c (mon.1) 346 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:54.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:52.868490+0000 mgr.y (mgr.44106) 307 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:54.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:53.468566+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:54.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:53.470070+0000 mon.c (mon.1) 345 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:54.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:53.472031+0000 mon.c (mon.1) 346 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:54.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:52.868490+0000 mgr.y (mgr.44106) 307 : cluster [DBG] pgmap v206: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:54.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:53.468566+0000 mon.a (mon.0) 569 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:54.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:53.470070+0000 mon.c (mon.1) 345 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:54.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:53.472031+0000 mon.c (mon.1) 346 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:31:54.993 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:31:55.652 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (6m) 10s ago 12m 24.6M - 0.26.0 9f27df16978d 8b0542fa0b14 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (12m) 9s ago 12m 34.6M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (5m) 9s ago 16m 384M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (6m) 10s ago 18m 427M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (5m) 10s ago 18m 67.4M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (5m) 9s ago 16m 65.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (5m) 10s ago 16m 67.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (22s) 10s ago 12m 3611k - 1.3.1 1dbe0e931976 40fcddf1502d 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (14s) 9s ago 13m 3636k - 1.3.1 1dbe0e931976 60d93e84a643 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (4m) 10s ago 15m 47.6M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (3m) 10s ago 15m 46.2M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:31:55.653 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (3m) 10s ago 15m 40.0M 4096M 16.2.14-548-g81bd20d6 823b921721f5 f9b5c6109867 2024-02-17T23:31:55.654 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (2m) 10s ago 14m 46.9M 4096M 16.2.14-548-g81bd20d6 823b921721f5 050f8c4e76bc 2024-02-17T23:31:55.654 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (2m) 9s ago 14m 43.7M 4096M 16.2.14-548-g81bd20d6 823b921721f5 e57f1f319143 2024-02-17T23:31:55.654 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (111s) 9s ago 14m 42.1M 4096M 16.2.14-548-g81bd20d6 823b921721f5 c515261f8fad 2024-02-17T23:31:55.654 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (80s) 9s ago 13m 41.7M 4096M 16.2.14-548-g81bd20d6 823b921721f5 041e8ef3bef5 2024-02-17T23:31:55.654 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (50s) 9s ago 13m 41.3M 4096M 16.2.14-548-g81bd20d6 823b921721f5 eedc239c7683 2024-02-17T23:31:55.654 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 starting - - - - 2024-02-17T23:31:55.654 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (37s) 10s ago 11m 38.6M - 16.2.14-548-g81bd20d6 823b921721f5 fa950e80dd4a 2024-02-17T23:31:55.654 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (32s) 9s ago 11m 37.9M - 16.2.14-548-g81bd20d6 823b921721f5 7521e0381946 2024-02-17T23:31:56.049 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:31:56.049 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:31:56.049 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:31:56.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:31:56.049 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:31:56.049 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:31:56.049 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:31:56.049 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:31:56.049 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 8 2024-02-17T23:31:56.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:31:56.050 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:31:56.050 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:31:56.050 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:31:56.050 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:31:56.050 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:31:56.050 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 15 2024-02-17T23:31:56.050 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:31:56.050 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:31:56.374 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:31:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:31:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:31:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:31:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:31:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "osd", 2024-02-17T23:31:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:31:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-02-17T23:31:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw" 2024-02-17T23:31:56.375 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:31:56.376 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "15/20 daemons upgraded", 2024-02-17T23:31:56.376 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading prometheus daemons", 2024-02-17T23:31:56.376 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:31:56.376 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:31:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:54.869026+0000 mgr.y (mgr.44106) 308 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:54.975396+0000 mgr.y (mgr.44106) 309 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.641501+0000 mon.c (mon.1) 347 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.641875+0000 mon.c (mon.1) 348 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.642205+0000 mon.c (mon.1) 349 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.642535+0000 mon.c (mon.1) 350 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.642834+0000 mon.c (mon.1) 351 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.643136+0000 mon.c (mon.1) 352 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.644974+0000 mon.c (mon.1) 353 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.645319+0000 mon.c (mon.1) 354 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.645610+0000 mon.c (mon.1) 355 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.645903+0000 mon.c (mon.1) 356 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.646203+0000 mon.c (mon.1) 357 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:54.869026+0000 mgr.y (mgr.44106) 308 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:56.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:54.975396+0000 mgr.y (mgr.44106) 309 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:56.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.641501+0000 mon.c (mon.1) 347 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:56.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.641875+0000 mon.c (mon.1) 348 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:56.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.642205+0000 mon.c (mon.1) 349 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.642535+0000 mon.c (mon.1) 350 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.642834+0000 mon.c (mon.1) 351 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.643136+0000 mon.c (mon.1) 352 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.644974+0000 mon.c (mon.1) 353 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:56.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.645319+0000 mon.c (mon.1) 354 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.645610+0000 mon.c (mon.1) 355 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.645903+0000 mon.c (mon.1) 356 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.646203+0000 mon.c (mon.1) 357 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:54.869026+0000 mgr.y (mgr.44106) 308 : cluster [DBG] pgmap v207: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:54.975396+0000 mgr.y (mgr.44106) 309 : audit [DBG] from='client.54493 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.641501+0000 mon.c (mon.1) 347 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.641875+0000 mon.c (mon.1) 348 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.642205+0000 mon.c (mon.1) 349 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.642535+0000 mon.c (mon.1) 350 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.642834+0000 mon.c (mon.1) 351 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.643136+0000 mon.c (mon.1) 352 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.644974+0000 mon.c (mon.1) 353 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:31:56.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.645319+0000 mon.c (mon.1) 354 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.645610+0000 mon.c (mon.1) 355 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.645903+0000 mon.c (mon.1) 356 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:56.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.646203+0000 mon.c (mon.1) 357 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:31:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.317830+0000 mgr.y (mgr.44106) 310 : audit [DBG] from='client.54499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:55.639587+0000 mgr.y (mgr.44106) 311 : audit [DBG] from='client.44553 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:57.140 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:56.047789+0000 mon.c (mon.1) 358 : audit [DBG] from='client.44559 172.21.15.5:0/3978847645' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:57.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.317830+0000 mgr.y (mgr.44106) 310 : audit [DBG] from='client.54499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:57.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:55.639587+0000 mgr.y (mgr.44106) 311 : audit [DBG] from='client.44553 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:57.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:56.047789+0000 mon.c (mon.1) 358 : audit [DBG] from='client.44559 172.21.15.5:0/3978847645' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:57.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.317830+0000 mgr.y (mgr.44106) 310 : audit [DBG] from='client.54499 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:57.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:55.639587+0000 mgr.y (mgr.44106) 311 : audit [DBG] from='client.44553 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:57.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:56.047789+0000 mon.c (mon.1) 358 : audit [DBG] from='client.44559 172.21.15.5:0/3978847645' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:56.373137+0000 mgr.y (mgr.44106) 312 : audit [DBG] from='client.54517 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:58.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:56.869754+0000 mgr.y (mgr.44106) 313 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:58.337 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.477670+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.483292+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.489892+0000 mon.c (mon.1) 359 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.492006+0000 mon.c (mon.1) 360 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.494825+0000 mon.c (mon.1) 361 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.496240+0000 mon.c (mon.1) 362 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.497355+0000 mon.c (mon.1) 363 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.499215+0000 mon.c (mon.1) 364 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.500788+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.502060+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.503127+0000 mon.c (mon.1) 367 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.504166+0000 mon.c (mon.1) 368 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.505217+0000 mon.c (mon.1) 369 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.506237+0000 mon.c (mon.1) 370 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.507642+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.338 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.508925+0000 mon.c (mon.1) 372 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:56.373137+0000 mgr.y (mgr.44106) 312 : audit [DBG] from='client.54517 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:56.869754+0000 mgr.y (mgr.44106) 313 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.477670+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.483292+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.489892+0000 mon.c (mon.1) 359 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.492006+0000 mon.c (mon.1) 360 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.494825+0000 mon.c (mon.1) 361 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.496240+0000 mon.c (mon.1) 362 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.497355+0000 mon.c (mon.1) 363 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.499215+0000 mon.c (mon.1) 364 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.339 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.500788+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.340 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.502060+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.340 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.503127+0000 mon.c (mon.1) 367 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.340 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.504166+0000 mon.c (mon.1) 368 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.340 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.505217+0000 mon.c (mon.1) 369 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.340 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.506237+0000 mon.c (mon.1) 370 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.340 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.507642+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.340 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.508925+0000 mon.c (mon.1) 372 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:56.373137+0000 mgr.y (mgr.44106) 312 : audit [DBG] from='client.54517 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:56.869754+0000 mgr.y (mgr.44106) 313 : cluster [DBG] pgmap v208: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 3.6 KiB/s rd, 170 B/s wr, 3 op/s 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.477670+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.483292+0000 mon.a (mon.0) 571 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.489892+0000 mon.c (mon.1) 359 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.492006+0000 mon.c (mon.1) 360 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.494825+0000 mon.c (mon.1) 361 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.496240+0000 mon.c (mon.1) 362 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.497355+0000 mon.c (mon.1) 363 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.499215+0000 mon.c (mon.1) 364 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.500788+0000 mon.c (mon.1) 365 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.502060+0000 mon.c (mon.1) 366 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.503127+0000 mon.c (mon.1) 367 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.504166+0000 mon.c (mon.1) 368 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.505217+0000 mon.c (mon.1) 369 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.506237+0000 mon.c (mon.1) 370 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.507642+0000 mon.c (mon.1) 371 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:58.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.508925+0000 mon.c (mon.1) 372 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:31:59.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:31:57.490311+0000 mgr.y (mgr.44106) 314 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:31:59.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:31:57.490311+0000 mgr.y (mgr.44106) 314 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:31:59.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:31:57.490311+0000 mgr.y (mgr.44106) 314 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-02-17T23:32:00.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:31:58.870504+0000 mgr.y (mgr.44106) 315 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 170 B/s wr, 1 op/s 2024-02-17T23:32:00.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:59.147334+0000 mgr.y (mgr.44106) 316 : cephadm [INF] Upgrade: Updating alertmanager.a 2024-02-17T23:32:00.023 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:31:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:31:59.153823+0000 mgr.y (mgr.44106) 317 : cephadm [INF] Deploying daemon alertmanager.a on smithi005 2024-02-17T23:32:00.023 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:31:58.870504+0000 mgr.y (mgr.44106) 315 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 170 B/s wr, 1 op/s 2024-02-17T23:32:00.023 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:59.147334+0000 mgr.y (mgr.44106) 316 : cephadm [INF] Upgrade: Updating alertmanager.a 2024-02-17T23:32:00.023 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:31:59 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:31:59.153823+0000 mgr.y (mgr.44106) 317 : cephadm [INF] Deploying daemon alertmanager.a on smithi005 2024-02-17T23:32:00.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:31:58.870504+0000 mgr.y (mgr.44106) 315 : cluster [DBG] pgmap v209: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.4 KiB/s rd, 170 B/s wr, 1 op/s 2024-02-17T23:32:00.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:59.147334+0000 mgr.y (mgr.44106) 316 : cephadm [INF] Upgrade: Updating alertmanager.a 2024-02-17T23:32:00.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:31:59 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:31:59.153823+0000 mgr.y (mgr.44106) 317 : cephadm [INF] Deploying daemon alertmanager.a on smithi005 2024-02-17T23:32:02.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:00.871154+0000 mgr.y (mgr.44106) 318 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-17T23:32:02.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:00.871154+0000 mgr.y (mgr.44106) 318 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-17T23:32:02.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:01 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:00.871154+0000 mgr.y (mgr.44106) 318 : cluster [DBG] pgmap v210: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-02-17T23:32:03.008 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:02 smithi005 systemd[1]: Stopping Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:32:03.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:03 smithi005 bash[57630]: ts=2024-02-17T23:32:03.005Z caller=main.go:594 level=info msg="Received SIGTERM, exiting gracefully..." 2024-02-17T23:32:03.724 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:03 smithi005 bash[74139]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager.a 2024-02-17T23:32:03.892 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:32:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:32:03.507Z caller=notifier.go:526 level=error component=notifier alertmanager=http://smithi005.front.sepia.ceph.com:9093/api/v2/alerts count=6 msg="Error sending alert" err="Post \"http://smithi005.front.sepia.ceph.com:9093/api/v2/alerts\": dial tcp 172.21.15.5:9093: connect: connection refused" 2024-02-17T23:32:04.286 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:02.871608+0000 mgr.y (mgr.44106) 319 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:04.287 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:02.871608+0000 mgr.y (mgr.44106) 319 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:04.287 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:04 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-17T23:32:04.287 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:04 smithi005 systemd[1]: Stopped Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:32:04.287 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:04 smithi005 systemd[1]: Starting Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:32:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:02.871608+0000 mgr.y (mgr.44106) 319 : cluster [DBG] pgmap v211: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:05.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:32:05.042Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-02-17T23:32:05.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:32:05.042Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-02-17T23:32:05.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:32:05.044Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.5 port=9094 2024-02-17T23:32:05.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:32:05.046Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-02-17T23:32:05.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:32:05.071Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-17T23:32:05.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:32:05.071Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-02-17T23:32:05.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:32:05.075Z caller=main.go:518 msg=Listening address=:9093 2024-02-17T23:32:05.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:32:05.075Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-02-17T23:32:05.377 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:05 smithi005 bash[74324]: 1d950c856fcc01c1933eb959a6d1fe985f28cff939331e7668836561ca2dbcdd 2024-02-17T23:32:05.377 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:05 smithi005 systemd[1]: Started Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:32:06.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:04.872540+0000 mgr.y (mgr.44106) 320 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:06.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:05.206182+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:06.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:05.207414+0000 mon.c (mon.1) 373 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:06.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:05.208857+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:32:06.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:04.872540+0000 mgr.y (mgr.44106) 320 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:06.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:05.206182+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:06.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:05.207414+0000 mon.c (mon.1) 373 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:06.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:05.208857+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:32:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:04.872540+0000 mgr.y (mgr.44106) 320 : cluster [DBG] pgmap v212: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:05.206182+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:05.207414+0000 mon.c (mon.1) 373 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:05.208857+0000 mon.c (mon.1) 374 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:32:07.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:07 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:32:07.046Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000214895s 2024-02-17T23:32:08.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:06.873119+0000 mgr.y (mgr.44106) 321 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:08.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:06.873119+0000 mgr.y (mgr.44106) 321 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:08.639 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:06.873119+0000 mgr.y (mgr.44106) 321 : cluster [DBG] pgmap v213: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:09.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.250401+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:09.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.256212+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:09.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.261398+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:32:09.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.263170+0000 mon.c (mon.1) 376 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:09.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.265669+0000 mon.c (mon.1) 377 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.266911+0000 mon.c (mon.1) 378 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.267818+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.269480+0000 mon.c (mon.1) 380 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.270906+0000 mon.c (mon.1) 381 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.272071+0000 mon.c (mon.1) 382 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.273027+0000 mon.c (mon.1) 383 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.273928+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.274835+0000 mon.c (mon.1) 385 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.275794+0000 mon.c (mon.1) 386 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.277069+0000 mon.c (mon.1) 387 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.278260+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.279369+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.250401+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.256212+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:09.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.261398+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.263170+0000 mon.c (mon.1) 376 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.265669+0000 mon.c (mon.1) 377 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.266911+0000 mon.c (mon.1) 378 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.267818+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.269480+0000 mon.c (mon.1) 380 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.270906+0000 mon.c (mon.1) 381 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.272071+0000 mon.c (mon.1) 382 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.273027+0000 mon.c (mon.1) 383 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.273928+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.274835+0000 mon.c (mon.1) 385 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.275794+0000 mon.c (mon.1) 386 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.277069+0000 mon.c (mon.1) 387 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.278260+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.279369+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.250401+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.256212+0000 mon.a (mon.0) 574 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.261398+0000 mon.c (mon.1) 375 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.263170+0000 mon.c (mon.1) 376 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.265669+0000 mon.c (mon.1) 377 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.266911+0000 mon.c (mon.1) 378 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.267818+0000 mon.c (mon.1) 379 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.269480+0000 mon.c (mon.1) 380 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.270906+0000 mon.c (mon.1) 381 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.272071+0000 mon.c (mon.1) 382 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.273027+0000 mon.c (mon.1) 383 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.273928+0000 mon.c (mon.1) 384 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.274835+0000 mon.c (mon.1) 385 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.275794+0000 mon.c (mon.1) 386 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.277069+0000 mon.c (mon.1) 387 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.278260+0000 mon.c (mon.1) 388 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:09.629 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:09 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.279369+0000 mon.c (mon.1) 389 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:08.261722+0000 mgr.y (mgr.44106) 322 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:32:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:08.873649+0000 mgr.y (mgr.44106) 323 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:09.806023+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:09.809490+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:09.812340+0000 mon.c (mon.1) 390 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-17T23:32:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:09.816808+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:08.261722+0000 mgr.y (mgr.44106) 322 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:32:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:08.873649+0000 mgr.y (mgr.44106) 323 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:09.806023+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:09.809490+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:09.812340+0000 mon.c (mon.1) 390 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-17T23:32:10.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:09.816808+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:08.261722+0000 mgr.y (mgr.44106) 322 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-02-17T23:32:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:08.873649+0000 mgr.y (mgr.44106) 323 : cluster [DBG] pgmap v214: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:09.806023+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:09.809490+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:09.812340+0000 mon.c (mon.1) 390 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-17T23:32:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:09.816808+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:32:09.740206+0000 mgr.y (mgr.44106) 324 : cephadm [INF] Upgrade: Updating grafana.a 2024-02-17T23:32:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:09.812758+0000 mgr.y (mgr.44106) 325 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-17T23:32:11.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:32:09.821793+0000 mgr.y (mgr.44106) 326 : cephadm [INF] Deploying daemon grafana.a on smithi080 2024-02-17T23:32:11.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:32:09.740206+0000 mgr.y (mgr.44106) 324 : cephadm [INF] Upgrade: Updating grafana.a 2024-02-17T23:32:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:09.812758+0000 mgr.y (mgr.44106) 325 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-17T23:32:11.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:32:09.821793+0000 mgr.y (mgr.44106) 326 : cephadm [INF] Deploying daemon grafana.a on smithi080 2024-02-17T23:32:11.639 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:32:09.740206+0000 mgr.y (mgr.44106) 324 : cephadm [INF] Upgrade: Updating grafana.a 2024-02-17T23:32:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:09.812758+0000 mgr.y (mgr.44106) 325 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-02-17T23:32:11.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:32:09.821793+0000 mgr.y (mgr.44106) 326 : cephadm [INF] Deploying daemon grafana.a on smithi080 2024-02-17T23:32:12.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:10.874313+0000 mgr.y (mgr.44106) 327 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:12.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:10.874313+0000 mgr.y (mgr.44106) 327 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:12.639 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:10.874313+0000 mgr.y (mgr.44106) 327 : cluster [DBG] pgmap v215: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:13.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:12.874862+0000 mgr.y (mgr.44106) 328 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:13.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:12.874862+0000 mgr.y (mgr.44106) 328 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:13.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:12.874862+0000 mgr.y (mgr.44106) 328 : cluster [DBG] pgmap v216: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:15.376 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:32:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:32:15.048Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.002627862s 2024-02-17T23:32:16.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:14.875678+0000 mgr.y (mgr.44106) 329 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:16.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:14.875678+0000 mgr.y (mgr.44106) 329 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:16.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:14.875678+0000 mgr.y (mgr.44106) 329 : cluster [DBG] pgmap v217: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:18.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:16.876310+0000 mgr.y (mgr.44106) 330 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:18.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:17 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:16.876310+0000 mgr.y (mgr.44106) 330 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:18.389 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:16.876310+0000 mgr.y (mgr.44106) 330 : cluster [DBG] pgmap v218: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:20.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:18.876889+0000 mgr.y (mgr.44106) 331 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:20.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:19 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:18.876889+0000 mgr.y (mgr.44106) 331 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:20.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:18.876889+0000 mgr.y (mgr.44106) 331 : cluster [DBG] pgmap v219: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:22.066 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:20.877387+0000 mgr.y (mgr.44106) 332 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:22.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:20.877387+0000 mgr.y (mgr.44106) 332 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:22.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:20.877387+0000 mgr.y (mgr.44106) 332 : cluster [DBG] pgmap v220: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:22.390 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 systemd[1]: Stopping Ceph grafana.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:32:22.390 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped Stream Manager" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped CleanUpService" logger=server reason="context canceled" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped BackendPluginManager" logger=server reason="context canceled" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped NotificationService" logger=server reason="context canceled" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped AlertEngine" logger=server reason="context canceled" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped InternalMetricsService" logger=server reason="context canceled" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped RemoteCache" logger=server reason="context canceled" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped UsageStatsService" logger=server reason="context canceled" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped PluginManager" logger=server reason="context canceled" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped provisioningServiceImpl" logger=server reason="context canceled" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=info msg="Stopped UserAuthTokenService" logger=server reason="context canceled" 2024-02-17T23:32:22.391 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:22 smithi080 bash[45346]: t=2024-02-17T23:32:22+0000 lvl=eror msg="Server shutdown" logger=server reason=nil 2024-02-17T23:32:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:22.878046+0000 mgr.y (mgr.44106) 333 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:24.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:22.878046+0000 mgr.y (mgr.44106) 333 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:24.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:22.878046+0000 mgr.y (mgr.44106) 333 : cluster [DBG] pgmap v221: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:25.890 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:25 smithi080 bash[66940]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana.a 2024-02-17T23:32:26.338 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:24.878596+0000 mgr.y (mgr.44106) 334 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:24.878596+0000 mgr.y (mgr.44106) 334 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:26.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:24.878596+0000 mgr.y (mgr.44106) 334 : cluster [DBG] pgmap v222: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:26.640 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:26 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@grafana.a.service: Main process exited, code=exited, status=1/FAILURE 2024-02-17T23:32:26.731 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:32:27.140 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:26 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@grafana.a.service: Failed with result 'exit-code'. 2024-02-17T23:32:27.140 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:26 smithi080 systemd[1]: Stopped Ceph grafana.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:32:27.140 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:26 smithi080 systemd[1]: Starting Ceph grafana.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:32:27.377 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:32:27.377 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (22s) 19s ago 13m 14.6M - 0.23.0 ba2b418f427c 1d950c856fcc 2024-02-17T23:32:27.377 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (12m) 29s ago 12m 34.6M - 6.6.2 87a51ecf0b1c 7e1204fc1c45 2024-02-17T23:32:27.377 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (6m) 29s ago 16m 385M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (6m) 19s ago 18m 428M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (6m) 19s ago 18m 63.2M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (5m) 29s ago 17m 66.2M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (5m) 19s ago 17m 53.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (53s) 19s ago 13m 12.0M - 1.3.1 1dbe0e931976 40fcddf1502d 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (46s) 29s ago 13m 10.2M - 1.3.1 1dbe0e931976 60d93e84a643 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (4m) 19s ago 16m 47.8M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (4m) 19s ago 16m 45.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (3m) 19s ago 15m 40.1M 4096M 16.2.14-548-g81bd20d6 823b921721f5 f9b5c6109867 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (3m) 19s ago 15m 47.3M 4096M 16.2.14-548-g81bd20d6 823b921721f5 050f8c4e76bc 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (2m) 29s ago 15m 44.0M 4096M 16.2.14-548-g81bd20d6 823b921721f5 e57f1f319143 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (2m) 29s ago 14m 42.4M 4096M 16.2.14-548-g81bd20d6 823b921721f5 c515261f8fad 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (112s) 29s ago 14m 42.0M 4096M 16.2.14-548-g81bd20d6 823b921721f5 041e8ef3bef5 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (82s) 29s ago 14m 41.7M 4096M 16.2.14-548-g81bd20d6 823b921721f5 eedc239c7683 2024-02-17T23:32:27.378 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (34s) 29s ago 13m 35.7M - 2.33.4 514e6a882f6e 9f6c7049fa28 2024-02-17T23:32:27.379 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (69s) 19s ago 11m 38.8M - 16.2.14-548-g81bd20d6 823b921721f5 fa950e80dd4a 2024-02-17T23:32:27.379 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (63s) 29s ago 11m 38.0M - 16.2.14-548-g81bd20d6 823b921721f5 7521e0381946 2024-02-17T23:32:27.768 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:32:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:32:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:32:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:32:27.768 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 8 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 15 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:32:27.769 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:32:27.809 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-02-17T23:32:27.809 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-02-17T23:32:27.809 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-02-17T23:32:27.809 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-02-17T23:32:27.809 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="App mode production" logger=settings 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-02-17T23:32:27.810 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-02-17T23:32:27.811 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index user.login/user.email" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_service_account column to user" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_email - v1" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_org_id - v1" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_code - v1" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_status - v1" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create temp_user v2" 2024-02-17T23:32:27.812 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v2" 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v2" 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 bash[67120]: 8467917cd34ce4c378321334e2cfb33b335e6775531cec6a8ca9907ce9d30a4e 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v2" 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 systemd[1]: Started Ceph grafana.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v2" 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy temp_user v1 to v2" 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop temp_user_tmp_qwerty" 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Set created for temp users that will otherwise prematurely expire" 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-02-17T23:32:27.813 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-02-17T23:32:27.815 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-02-17T23:32:27.816 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-02-17T23:32:27.817 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-02-17T23:32:27.818 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-02-17T23:32:27.819 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-02-17T23:32:27.820 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-02-17T23:32:27.821 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-02-17T23:32:27.822 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-02-17T23:32:27.823 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-02-17T23:32:27.824 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-02-17T23:32:27.825 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-02-17T23:32:27.826 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-02-17T23:32:27.827 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-02-17T23:32:27.828 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-02-17T23:32:27.828 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-02-17T23:32:28.060 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:26.718012+0000 mgr.y (mgr.44106) 335 : audit [DBG] from='client.44571 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:28.060 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:26.879039+0000 mgr.y (mgr.44106) 336 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:28.060 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.042990+0000 mgr.y (mgr.44106) 337 : audit [DBG] from='client.54529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:28.060 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.366494+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:32:28.060 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.366881+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:32:28.061 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.367207+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.061 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.367516+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.061 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.367811+0000 mon.c (mon.1) 395 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.061 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.368114+0000 mon.c (mon.1) 396 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.061 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.369753+0000 mon.c (mon.1) 397 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:32:28.061 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.370058+0000 mon.c (mon.1) 398 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.061 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.370368+0000 mon.c (mon.1) 399 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.061 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.370657+0000 mon.c (mon.1) 400 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.061 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.370939+0000 mon.c (mon.1) 401 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.061 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-02-17T23:32:28.062 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-02-17T23:32:28.063 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-02-17T23:32:28.063 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-02-17T23:32:28.063 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-02-17T23:32:28.063 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-02-17T23:32:28.063 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.650714+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:28.063 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.651931+0000 mon.c (mon.1) 402 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:28.063 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.653453+0000 mon.c (mon.1) 403 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:32:28.063 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.767017+0000 mon.a (mon.0) 579 : audit [DBG] from='client.54541 172.21.15.5:0/2791445638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:28.064 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-02-17T23:32:28.064 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-02-17T23:32:28.064 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-02-17T23:32:28.064 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-02-17T23:32:28.065 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-02-17T23:32:28.066 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-02-17T23:32:28.067 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-02-17T23:32:28.068 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-02-17T23:32:28.069 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:27+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-02-17T23:32:28.070 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-02-17T23:32:28.071 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-02-17T23:32:28.071 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-02-17T23:32:28.071 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-02-17T23:32:28.071 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-02-17T23:32:28.071 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-02-17T23:32:28.071 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-02-17T23:32:28.071 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-02-17T23:32:28.071 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-02-17T23:32:28.071 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-02-17T23:32:28.071 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-02-17T23:32:28.072 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-02-17T23:32:28.073 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-02-17T23:32:28.074 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-02-17T23:32:28.074 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-02-17T23:32:28.074 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-02-17T23:32:28.074 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-02-17T23:32:28.074 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-02-17T23:32:28.074 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-02-17T23:32:28.074 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-02-17T23:32:28.074 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=500.487575ms 2024-02-17T23:32:28.074 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-02-17T23:32:28.101 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:7fa249cc0191869e2bcc743303b0da933d04d152b2397edb19ec992e48553ab9", 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "in_progress": true, 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "which": "Upgrading all daemon types on all hosts", 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "services_complete": [ 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "osd", 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr", 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "mon", 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw" 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: ], 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "progress": "15/20 daemons upgraded", 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "message": "Currently upgrading grafana daemons", 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout: "is_paused": false 2024-02-17T23:32:28.102 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:32:28.365 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-02-17T23:32:28.365 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-02-17T23:32:28.365 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-02-17T23:32:28.365 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-02-17T23:32:28.365 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-02-17T23:32:28.365 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-02-17T23:32:28.365 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-02-17T23:32:28.365 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-02-17T23:32:28.365 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-02-17T23:32:28.365 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:32:28+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-02-17T23:32:28.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:26.718012+0000 mgr.y (mgr.44106) 335 : audit [DBG] from='client.44571 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:28.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:26.879039+0000 mgr.y (mgr.44106) 336 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:28.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.042990+0000 mgr.y (mgr.44106) 337 : audit [DBG] from='client.54529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.366494+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.366881+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.367207+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.367516+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.367811+0000 mon.c (mon.1) 395 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.368114+0000 mon.c (mon.1) 396 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.369753+0000 mon.c (mon.1) 397 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.370058+0000 mon.c (mon.1) 398 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.370368+0000 mon.c (mon.1) 399 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.370657+0000 mon.c (mon.1) 400 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.370939+0000 mon.c (mon.1) 401 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:26.718012+0000 mgr.y (mgr.44106) 335 : audit [DBG] from='client.44571 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:26.879039+0000 mgr.y (mgr.44106) 336 : cluster [DBG] pgmap v223: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.042990+0000 mgr.y (mgr.44106) 337 : audit [DBG] from='client.54529 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.366494+0000 mon.c (mon.1) 391 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.366881+0000 mon.c (mon.1) 392 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.367207+0000 mon.c (mon.1) 393 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.367516+0000 mon.c (mon.1) 394 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.367811+0000 mon.c (mon.1) 395 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.368114+0000 mon.c (mon.1) 396 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.369753+0000 mon.c (mon.1) 397 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.370058+0000 mon.c (mon.1) 398 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.370368+0000 mon.c (mon.1) 399 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.370657+0000 mon.c (mon.1) 400 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.370939+0000 mon.c (mon.1) 401 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:32:28.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.650714+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:28.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.651931+0000 mon.c (mon.1) 402 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:28.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.653453+0000 mon.c (mon.1) 403 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:32:28.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.767017+0000 mon.a (mon.0) 579 : audit [DBG] from='client.54541 172.21.15.5:0/2791445638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:28.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.650714+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:28.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.651931+0000 mon.c (mon.1) 402 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:28.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.653453+0000 mon.c (mon.1) 403 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon","key": "container_image"}]: dispatch 2024-02-17T23:32:28.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.767017+0000 mon.a (mon.0) 579 : audit [DBG] from='client.54541 172.21.15.5:0/2791445638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:27.364655+0000 mgr.y (mgr.44106) 338 : audit [DBG] from='client.44583 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:28.100130+0000 mgr.y (mgr.44106) 339 : audit [DBG] from='client.54547 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:28.834680+0000 mon.c (mon.1) 404 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-17T23:32:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:28.835027+0000 mon.c (mon.1) 405 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:28.835115+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:28.835401+0000 mon.c (mon.1) 406 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:28.835442+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:28.835761+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:28.835899+0000 mon.c (mon.1) 407 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:28.836333+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:27.364655+0000 mgr.y (mgr.44106) 338 : audit [DBG] from='client.44583 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:28.100130+0000 mgr.y (mgr.44106) 339 : audit [DBG] from='client.54547 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:28.834680+0000 mon.c (mon.1) 404 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:28.835027+0000 mon.c (mon.1) 405 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:28.835115+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-17T23:32:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:28.835401+0000 mon.c (mon.1) 406 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:32:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:28.835442+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:28.835761+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:32:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:28.835899+0000 mon.c (mon.1) 407 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:28.836333+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:27.364655+0000 mgr.y (mgr.44106) 338 : audit [DBG] from='client.44583 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:28.100130+0000 mgr.y (mgr.44106) 339 : audit [DBG] from='client.54547 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:32:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:28.834680+0000 mon.c (mon.1) 404 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-17T23:32:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:28.835027+0000 mon.c (mon.1) 405 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:28.835115+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 2]}]: dispatch 2024-02-17T23:32:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:28.835401+0000 mon.c (mon.1) 406 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:32:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:28.835442+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:28.835761+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:32:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:28.835899+0000 mon.c (mon.1) 407 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:32:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:28.836333+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [1, 2]}]: dispatch 2024-02-17T23:32:30.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:28.879784+0000 mgr.y (mgr.44106) 340 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:30.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:28.879784+0000 mgr.y (mgr.44106) 340 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:30.880453+0000 mgr.y (mgr.44106) 341 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.603030+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.887587+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.895094+0000 mon.c (mon.1) 408 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-17T23:32:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.896623+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi080.front.sepia.ceph.com:3000"}]: dispatch 2024-02-17T23:32:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.901458+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.904527+0000 mon.c (mon.1) 410 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.911757+0000 mon.c (mon.1) 411 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.913515+0000 mon.c (mon.1) 412 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.914968+0000 mon.c (mon.1) 413 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.917827+0000 mon.c (mon.1) 414 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.919713+0000 mon.c (mon.1) 415 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.921260+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.922511+0000 mon.c (mon.1) 417 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.923770+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.925069+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:30.880453+0000 mgr.y (mgr.44106) 341 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.603030+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.887587+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.895094+0000 mon.c (mon.1) 408 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.896623+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi080.front.sepia.ceph.com:3000"}]: dispatch 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.901458+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.904527+0000 mon.c (mon.1) 410 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.911757+0000 mon.c (mon.1) 411 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.913515+0000 mon.c (mon.1) 412 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.914968+0000 mon.c (mon.1) 413 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.917827+0000 mon.c (mon.1) 414 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.919713+0000 mon.c (mon.1) 415 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.921260+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.922511+0000 mon.c (mon.1) 417 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.923770+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.379 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.925069+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.926314+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.928199+0000 mon.c (mon.1) 421 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.929653+0000 mon.c (mon.1) 422 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.931285+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.932932+0000 mon.c (mon.1) 424 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.938207+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.939048+0000 mon.c (mon.1) 425 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-17T23:32:32.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.939336+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-17T23:32:32.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.942632+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.943595+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.943884+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.946836+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.947674+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.947969+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.926314+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.928199+0000 mon.c (mon.1) 421 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.929653+0000 mon.c (mon.1) 422 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.931285+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.932932+0000 mon.c (mon.1) 424 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.938207+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.939048+0000 mon.c (mon.1) 425 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-17T23:32:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.939336+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-17T23:32:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.942632+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-17T23:32:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.943595+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.943884+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.946836+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-17T23:32:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.947674+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-17T23:32:32.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.947969+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-17T23:32:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:28.879784+0000 mgr.y (mgr.44106) 340 : cluster [DBG] pgmap v224: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:30.880453+0000 mgr.y (mgr.44106) 341 : cluster [DBG] pgmap v225: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.603030+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.887587+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.895094+0000 mon.c (mon.1) 408 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-17T23:32:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.896623+0000 mon.c (mon.1) 409 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi080.front.sepia.ceph.com:3000"}]: dispatch 2024-02-17T23:32:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.901458+0000 mon.a (mon.0) 586 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.904527+0000 mon.c (mon.1) 410 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.911757+0000 mon.c (mon.1) 411 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.913515+0000 mon.c (mon.1) 412 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.914968+0000 mon.c (mon.1) 413 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.917827+0000 mon.c (mon.1) 414 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.919713+0000 mon.c (mon.1) 415 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.921260+0000 mon.c (mon.1) 416 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.922511+0000 mon.c (mon.1) 417 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.923770+0000 mon.c (mon.1) 418 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.925069+0000 mon.c (mon.1) 419 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.926314+0000 mon.c (mon.1) 420 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.928199+0000 mon.c (mon.1) 421 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.929653+0000 mon.c (mon.1) 422 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.931285+0000 mon.c (mon.1) 423 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.932932+0000 mon.c (mon.1) 424 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:32:32.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.938207+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.939048+0000 mon.c (mon.1) 425 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-17T23:32:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.939336+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-02-17T23:32:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.942632+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-02-17T23:32:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.943595+0000 mon.c (mon.1) 426 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.943884+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.946836+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-02-17T23:32:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.947674+0000 mon.c (mon.1) 427 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-17T23:32:32.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.947969+0000 mon.a (mon.0) 592 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-02-17T23:32:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.895578+0000 mgr.y (mgr.44106) 342 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-17T23:32:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.897000+0000 mgr.y (mgr.44106) 343 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi080.front.sepia.ceph.com:3000"}]: dispatch 2024-02-17T23:32:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:32:31.933731+0000 mgr.y (mgr.44106) 344 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-17T23:32:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.950928+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-17T23:32:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.951911+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-17T23:32:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.956642+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-17T23:32:33.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.959976+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-17T23:32:33.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.960882+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-17T23:32:33.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.961201+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-17T23:32:33.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.964263+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-17T23:32:33.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.965410+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-17T23:32:33.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.965746+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-17T23:32:33.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.968633+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-17T23:32:33.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.969721+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-17T23:32:33.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.895578+0000 mgr.y (mgr.44106) 342 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.897000+0000 mgr.y (mgr.44106) 343 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi080.front.sepia.ceph.com:3000"}]: dispatch 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:32:31.933731+0000 mgr.y (mgr.44106) 344 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.950928+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.951911+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.956642+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.959976+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.960882+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.961201+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.964263+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.965410+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.965746+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.968633+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.969721+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-17T23:32:33.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.970054+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.972988+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.973966+0000 mon.c (mon.1) 432 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.974254+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.974973+0000 mon.c (mon.1) 433 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.975240+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.978012+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.979186+0000 mon.c (mon.1) 434 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.979459+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.982333+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.983417+0000 mon.c (mon.1) 435 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.983699+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.984395+0000 mon.c (mon.1) 436 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.984652+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.985318+0000 mon.c (mon.1) 437 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.970054+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.972988+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.973966+0000 mon.c (mon.1) 432 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.974254+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.974973+0000 mon.c (mon.1) 433 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.975240+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.978012+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.979186+0000 mon.c (mon.1) 434 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.979459+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.982333+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.983417+0000 mon.c (mon.1) 435 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.380 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.983699+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.984395+0000 mon.c (mon.1) 436 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.984652+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.381 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.985318+0000 mon.c (mon.1) 437 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.985580+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.986253+0000 mon.c (mon.1) 438 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.986499+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.987158+0000 mon.c (mon.1) 439 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-17T23:32:33.381 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.987414+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-17T23:32:33.382 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.990224+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-17T23:32:33.382 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cephadm 2024-02-17T23:32:31.991182+0000 mgr.y (mgr.44106) 345 : cephadm [INF] Upgrade: Complete! 2024-02-17T23:32:33.382 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.991579+0000 mon.c (mon.1) 440 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:32:33.382 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.991854+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:32:33.382 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.994043+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-17T23:32:33.382 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.994804+0000 mon.c (mon.1) 441 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:33.382 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:31.999871+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:33.382 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:32.003912+0000 mon.c (mon.1) 442 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:33.382 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:32.009051+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.985580+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.986253+0000 mon.c (mon.1) 438 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.986499+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.987158+0000 mon.c (mon.1) 439 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.987414+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.990224+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cephadm 2024-02-17T23:32:31.991182+0000 mgr.y (mgr.44106) 345 : cephadm [INF] Upgrade: Complete! 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.991579+0000 mon.c (mon.1) 440 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.991854+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.994043+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.994804+0000 mon.c (mon.1) 441 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:31.999871+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:33.383 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:32.003912+0000 mon.c (mon.1) 442 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:33.384 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:32.009051+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:33.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.895578+0000 mgr.y (mgr.44106) 342 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-02-17T23:32:33.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.897000+0000 mgr.y (mgr.44106) 343 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi080.front.sepia.ceph.com:3000"}]: dispatch 2024-02-17T23:32:33.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:32:31.933731+0000 mgr.y (mgr.44106) 344 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-02-17T23:32:33.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.950928+0000 mon.a (mon.0) 593 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-02-17T23:32:33.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.951911+0000 mon.c (mon.1) 428 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-17T23:32:33.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.956642+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-02-17T23:32:33.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.959976+0000 mon.a (mon.0) 595 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-02-17T23:32:33.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.960882+0000 mon.c (mon.1) 429 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-17T23:32:33.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.961201+0000 mon.a (mon.0) 596 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-02-17T23:32:33.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.964263+0000 mon.a (mon.0) 597 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-02-17T23:32:33.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.965410+0000 mon.c (mon.1) 430 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-17T23:32:33.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.965746+0000 mon.a (mon.0) 598 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-02-17T23:32:33.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.968633+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.969721+0000 mon.c (mon.1) 431 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.970054+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.972988+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.973966+0000 mon.c (mon.1) 432 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.974254+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.974973+0000 mon.c (mon.1) 433 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.975240+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.978012+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.979186+0000 mon.c (mon.1) 434 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.979459+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.982333+0000 mon.a (mon.0) 606 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.983417+0000 mon.c (mon.1) 435 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.983699+0000 mon.a (mon.0) 607 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.984395+0000 mon.c (mon.1) 436 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.984652+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.985318+0000 mon.c (mon.1) 437 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.985580+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.986253+0000 mon.c (mon.1) 438 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.986499+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.987158+0000 mon.c (mon.1) 439 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.987414+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.990224+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cephadm 2024-02-17T23:32:31.991182+0000 mgr.y (mgr.44106) 345 : cephadm [INF] Upgrade: Complete! 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.991579+0000 mon.c (mon.1) 440 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.991854+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.994043+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.994804+0000 mon.c (mon.1) 441 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:31.999871+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:33.393 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:32.003912+0000 mon.c (mon.1) 442 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:32:33.394 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:32.009051+0000 mon.a (mon.0) 616 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:34.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:32.881012+0000 mgr.y (mgr.44106) 346 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:34.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:32.881012+0000 mgr.y (mgr.44106) 346 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:34.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:32.881012+0000 mgr.y (mgr.44106) 346 : cluster [DBG] pgmap v226: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:35.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:34.193936+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:35.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:34.193936+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:35.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:34.193936+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:32:36.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:34.881583+0000 mgr.y (mgr.44106) 347 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:36.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:34.881583+0000 mgr.y (mgr.44106) 347 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:36.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:34.881583+0000 mgr.y (mgr.44106) 347 : cluster [DBG] pgmap v227: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:38.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:36.882187+0000 mgr.y (mgr.44106) 348 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:38.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:36.882187+0000 mgr.y (mgr.44106) 348 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:38.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:36.882187+0000 mgr.y (mgr.44106) 348 : cluster [DBG] pgmap v228: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:40.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:38.882725+0000 mgr.y (mgr.44106) 349 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:40.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:38.882725+0000 mgr.y (mgr.44106) 349 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:40.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:38.882725+0000 mgr.y (mgr.44106) 349 : cluster [DBG] pgmap v229: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:42.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:40.883363+0000 mgr.y (mgr.44106) 350 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:42.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:42 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:40.883363+0000 mgr.y (mgr.44106) 350 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:42.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:40.883363+0000 mgr.y (mgr.44106) 350 : cluster [DBG] pgmap v230: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:44.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:44 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:42.883925+0000 mgr.y (mgr.44106) 351 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:44.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:44 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:42.883925+0000 mgr.y (mgr.44106) 351 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:44.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:44 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:42.883925+0000 mgr.y (mgr.44106) 351 : cluster [DBG] pgmap v231: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:46.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:44.884638+0000 mgr.y (mgr.44106) 352 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:46.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:46 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:44.884638+0000 mgr.y (mgr.44106) 352 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:46.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:46 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:44.884638+0000 mgr.y (mgr.44106) 352 : cluster [DBG] pgmap v232: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:48.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:46.885198+0000 mgr.y (mgr.44106) 353 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:48.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:48 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:46.885198+0000 mgr.y (mgr.44106) 353 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:48.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:48 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:46.885198+0000 mgr.y (mgr.44106) 353 : cluster [DBG] pgmap v233: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:50.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:50 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:48.885669+0000 mgr.y (mgr.44106) 354 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:50.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:50 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:48.885669+0000 mgr.y (mgr.44106) 354 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:50.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:50 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:48.885669+0000 mgr.y (mgr.44106) 354 : cluster [DBG] pgmap v234: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:52.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:50.886239+0000 mgr.y (mgr.44106) 355 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:52.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:52 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:50.886239+0000 mgr.y (mgr.44106) 355 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:52.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:52 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:50.886239+0000 mgr.y (mgr.44106) 355 : cluster [DBG] pgmap v235: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:54.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:54 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:52.886810+0000 mgr.y (mgr.44106) 356 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:54.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:54 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:52.886810+0000 mgr.y (mgr.44106) 356 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:54.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:54 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:52.886810+0000 mgr.y (mgr.44106) 356 : cluster [DBG] pgmap v236: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:56.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:54.887497+0000 mgr.y (mgr.44106) 357 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:56.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:56 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:54.887497+0000 mgr.y (mgr.44106) 357 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:56.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:56 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:54.887497+0000 mgr.y (mgr.44106) 357 : cluster [DBG] pgmap v237: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:58.485 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:32:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:56.888125+0000 mgr.y (mgr.44106) 358 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:58.485 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:32:58 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:56.888125+0000 mgr.y (mgr.44106) 358 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:58.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:32:58 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:56.888125+0000 mgr.y (mgr.44106) 358 : cluster [DBG] pgmap v238: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:32:59.358 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph orch ps' 2024-02-17T23:33:00.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:32:58.445421+0000 mgr.y (mgr.44106) 359 : audit [DBG] from='client.54553 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:33:00.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:32:58.888556+0000 mgr.y (mgr.44106) 360 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:00.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:32:58.445421+0000 mgr.y (mgr.44106) 359 : audit [DBG] from='client.54553 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:33:00.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:32:58.888556+0000 mgr.y (mgr.44106) 360 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:00.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:32:58.445421+0000 mgr.y (mgr.44106) 359 : audit [DBG] from='client.54553 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:33:00.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:32:58.888556+0000 mgr.y (mgr.44106) 360 : cluster [DBG] pgmap v239: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:01.653 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (57s) 53s ago 13m 14.6M - 0.23.0 ba2b418f427c 1d950c856fcc 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (34s) 30s ago 13m 25.3M - 8.3.5 dad864ee21e9 8467917cd34c 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (6m) 30s ago 17m 385M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (7m) 53s ago 19m 428M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (6m) 53s ago 19m 63.2M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (6m) 30s ago 17m 52.4M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (6m) 53s ago 17m 53.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (88s) 53s ago 14m 12.0M - 1.3.1 1dbe0e931976 40fcddf1502d 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (80s) 30s ago 14m 15.3M - 1.3.1 1dbe0e931976 60d93e84a643 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (5m) 53s ago 17m 47.8M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (4m) 53s ago 16m 45.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:33:01.654 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (4m) 53s ago 16m 40.1M 4096M 16.2.14-548-g81bd20d6 823b921721f5 f9b5c6109867 2024-02-17T23:33:01.655 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (3m) 53s ago 15m 47.3M 4096M 16.2.14-548-g81bd20d6 823b921721f5 050f8c4e76bc 2024-02-17T23:33:01.655 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (3m) 30s ago 15m 44.1M 4096M 16.2.14-548-g81bd20d6 823b921721f5 e57f1f319143 2024-02-17T23:33:01.655 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (2m) 30s ago 15m 42.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 c515261f8fad 2024-02-17T23:33:01.655 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (2m) 30s ago 14m 42.1M 4096M 16.2.14-548-g81bd20d6 823b921721f5 041e8ef3bef5 2024-02-17T23:33:01.655 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (116s) 30s ago 14m 41.9M 4096M 16.2.14-548-g81bd20d6 823b921721f5 eedc239c7683 2024-02-17T23:33:01.655 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (68s) 30s ago 14m 44.7M - 2.33.4 514e6a882f6e 9f6c7049fa28 2024-02-17T23:33:01.655 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (103s) 53s ago 12m 38.8M - 16.2.14-548-g81bd20d6 823b921721f5 fa950e80dd4a 2024-02-17T23:33:01.655 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (98s) 30s ago 12m 38.2M - 16.2.14-548-g81bd20d6 823b921721f5 7521e0381946 2024-02-17T23:33:02.441 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph versions' 2024-02-17T23:33:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:00.889116+0000 mgr.y (mgr.44106) 361 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.642590+0000 mon.c (mon.1) 443 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:33:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.642995+0000 mon.c (mon.1) 444 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:33:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.643313+0000 mon.c (mon.1) 445 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.643631+0000 mon.c (mon.1) 446 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.643938+0000 mon.c (mon.1) 447 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.644241+0000 mon.c (mon.1) 448 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.645897+0000 mon.c (mon.1) 449 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.646213+0000 mon.c (mon.1) 450 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.646536+0000 mon.c (mon.1) 451 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.646833+0000 mon.c (mon.1) 452 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.647142+0000 mon.c (mon.1) 453 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:00.889116+0000 mgr.y (mgr.44106) 361 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.642590+0000 mon.c (mon.1) 443 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.642995+0000 mon.c (mon.1) 444 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.643313+0000 mon.c (mon.1) 445 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.643631+0000 mon.c (mon.1) 446 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.643938+0000 mon.c (mon.1) 447 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.627 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.644241+0000 mon.c (mon.1) 448 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.645897+0000 mon.c (mon.1) 449 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:33:02.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.646213+0000 mon.c (mon.1) 450 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.646536+0000 mon.c (mon.1) 451 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.646833+0000 mon.c (mon.1) 452 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.628 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.647142+0000 mon.c (mon.1) 453 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:00.889116+0000 mgr.y (mgr.44106) 361 : cluster [DBG] pgmap v240: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.642590+0000 mon.c (mon.1) 443 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:33:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.642995+0000 mon.c (mon.1) 444 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:33:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.643313+0000 mon.c (mon.1) 445 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.643631+0000 mon.c (mon.1) 446 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.643938+0000 mon.c (mon.1) 447 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.644241+0000 mon.c (mon.1) 448 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.645897+0000 mon.c (mon.1) 449 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:33:02.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.646213+0000 mon.c (mon.1) 450 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.646536+0000 mon.c (mon.1) 451 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.646833+0000 mon.c (mon.1) 452 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:02.641 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.647142+0000 mon.c (mon.1) 453 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:33:03.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:01.640736+0000 mgr.y (mgr.44106) 362 : audit [DBG] from='client.44607 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:33:03.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:03 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:01.640736+0000 mgr.y (mgr.44106) 362 : audit [DBG] from='client.44607 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:33:03.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:03 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:01.640736+0000 mgr.y (mgr.44106) 362 : audit [DBG] from='client.44607 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:33:04.374 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:02.889675+0000 mgr.y (mgr.44106) 363 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:04.374 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:02.889675+0000 mgr.y (mgr.44106) 363 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:04.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:02.889675+0000 mgr.y (mgr.44106) 363 : cluster [DBG] pgmap v241: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:05.046 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 8 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:33:05.047 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:33:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:33:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 15 2024-02-17T23:33:05.048 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:33:05.048 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:33:05.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:05.045483+0000 mon.c (mon.1) 454 : audit [DBG] from='client.44613 172.21.15.5:0/207055873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:33:05.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:05 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:05.045483+0000 mon.c (mon.1) 454 : audit [DBG] from='client.44613 172.21.15.5:0/207055873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:33:05.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:05 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:05.045483+0000 mon.c (mon.1) 454 : audit [DBG] from='client.44613 172.21.15.5:0/207055873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:33:05.905 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-02-17T23:33:06.511 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:04.890188+0000 mgr.y (mgr.44106) 364 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:06.512 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:04.890188+0000 mgr.y (mgr.44106) 364 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:06.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:04.890188+0000 mgr.y (mgr.44106) 364 : cluster [DBG] pgmap v242: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:08.003 INFO:teuthology.orchestra.run.smithi005.stdout:wait for servicemap items w/ changing names to refresh 2024-02-17T23:33:08.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:06.890668+0000 mgr.y (mgr.44106) 365 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:08.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:06.890668+0000 mgr.y (mgr.44106) 365 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:08.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:06.890668+0000 mgr.y (mgr.44106) 365 : cluster [DBG] pgmap v243: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:08.762 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'sleep 60' 2024-02-17T23:33:10.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:08.891073+0000 mgr.y (mgr.44106) 366 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:10.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:08.891073+0000 mgr.y (mgr.44106) 366 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:10.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:08.891073+0000 mgr.y (mgr.44106) 366 : cluster [DBG] pgmap v244: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:12.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:10.891585+0000 mgr.y (mgr.44106) 367 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:12.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:10.891585+0000 mgr.y (mgr.44106) 367 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:12.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:10.891585+0000 mgr.y (mgr.44106) 367 : cluster [DBG] pgmap v245: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:14.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:12.892307+0000 mgr.y (mgr.44106) 368 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:14.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:12.892307+0000 mgr.y (mgr.44106) 368 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:14.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:12.892307+0000 mgr.y (mgr.44106) 368 : cluster [DBG] pgmap v246: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:16.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:14.892905+0000 mgr.y (mgr.44106) 369 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:16.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:14.892905+0000 mgr.y (mgr.44106) 369 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:16.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:14.892905+0000 mgr.y (mgr.44106) 369 : cluster [DBG] pgmap v247: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:18.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:16.893487+0000 mgr.y (mgr.44106) 370 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:18.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:16.893487+0000 mgr.y (mgr.44106) 370 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:18.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:16.893487+0000 mgr.y (mgr.44106) 370 : cluster [DBG] pgmap v248: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:20.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:18.893959+0000 mgr.y (mgr.44106) 371 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:20.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:18.893959+0000 mgr.y (mgr.44106) 371 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:20.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:18.893959+0000 mgr.y (mgr.44106) 371 : cluster [DBG] pgmap v249: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:22.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:20.894557+0000 mgr.y (mgr.44106) 372 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:22.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:20.894557+0000 mgr.y (mgr.44106) 372 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:22.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:20.894557+0000 mgr.y (mgr.44106) 372 : cluster [DBG] pgmap v250: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:24.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:22.895035+0000 mgr.y (mgr.44106) 373 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:24.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:22.895035+0000 mgr.y (mgr.44106) 373 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:24.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:22.895035+0000 mgr.y (mgr.44106) 373 : cluster [DBG] pgmap v251: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:25.626 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:24.895788+0000 mgr.y (mgr.44106) 374 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:25.626 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:25 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:24.895788+0000 mgr.y (mgr.44106) 374 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:25.640 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:24.895788+0000 mgr.y (mgr.44106) 374 : cluster [DBG] pgmap v252: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:28.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:26.896562+0000 mgr.y (mgr.44106) 375 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:28.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:27 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:26.896562+0000 mgr.y (mgr.44106) 375 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:28.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:26.896562+0000 mgr.y (mgr.44106) 375 : cluster [DBG] pgmap v253: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:28.839445+0000 mon.c (mon.1) 455 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2024-02-17T23:33:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:28.839833+0000 mon.c (mon.1) 456 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-17T23:33:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:28.839901+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2024-02-17T23:33:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:28.840311+0000 mon.c (mon.1) 457 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:28.840321+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-17T23:33:29.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:28.840583+0000 mon.c (mon.1) 458 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:28.840975+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:28.841491+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:28.839445+0000 mon.c (mon.1) 455 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2024-02-17T23:33:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:28.839833+0000 mon.c (mon.1) 456 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-17T23:33:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:28.839901+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2024-02-17T23:33:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:28.840311+0000 mon.c (mon.1) 457 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:28.840321+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-17T23:33:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:28.840583+0000 mon.c (mon.1) 458 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:28.840975+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:28.841491+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:28.839445+0000 mon.c (mon.1) 455 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2024-02-17T23:33:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:28.839833+0000 mon.c (mon.1) 456 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-17T23:33:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:28.839901+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1c", "id": [7, 4]}]: dispatch 2024-02-17T23:33:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:28.840311+0000 mon.c (mon.1) 457 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:28.840321+0000 mon.a (mon.0) 619 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.4", "id": [1, 5]}]: dispatch 2024-02-17T23:33:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:28.840583+0000 mon.c (mon.1) 458 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:28.840975+0000 mon.a (mon.0) 620 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [1, 2]}]: dispatch 2024-02-17T23:33:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:28.841491+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.14", "id": [1, 2]}]: dispatch 2024-02-17T23:33:30.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:28.897036+0000 mgr.y (mgr.44106) 376 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:30.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:28.897036+0000 mgr.y (mgr.44106) 376 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:30.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:28.897036+0000 mgr.y (mgr.44106) 376 : cluster [DBG] pgmap v254: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:32.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:30.897671+0000 mgr.y (mgr.44106) 377 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:30.897671+0000 mgr.y (mgr.44106) 377 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:30.897671+0000 mgr.y (mgr.44106) 377 : cluster [DBG] pgmap v255: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:32.013173+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:33:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:33:32.326169+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:33:33.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:32.013173+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:33:33.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:33:32.326169+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:33:33.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:32.013173+0000 mon.c (mon.1) 459 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:33:33.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:33:32.326169+0000 mon.a (mon.0) 622 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:33:34.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:32.898301+0000 mgr.y (mgr.44106) 378 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:34.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:32.898301+0000 mgr.y (mgr.44106) 378 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:34.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:32.898301+0000 mgr.y (mgr.44106) 378 : cluster [DBG] pgmap v256: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:36.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:34.899114+0000 mgr.y (mgr.44106) 379 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:36.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:35 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:34.899114+0000 mgr.y (mgr.44106) 379 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:36.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:34.899114+0000 mgr.y (mgr.44106) 379 : cluster [DBG] pgmap v257: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:38.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:36.899636+0000 mgr.y (mgr.44106) 380 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:38.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:37 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:36.899636+0000 mgr.y (mgr.44106) 380 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:38.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:36.899636+0000 mgr.y (mgr.44106) 380 : cluster [DBG] pgmap v258: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:40.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:38.900200+0000 mgr.y (mgr.44106) 381 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:40.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:39 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:38.900200+0000 mgr.y (mgr.44106) 381 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:40.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:38.900200+0000 mgr.y (mgr.44106) 381 : cluster [DBG] pgmap v259: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:42.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:40.900718+0000 mgr.y (mgr.44106) 382 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:42.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:41 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:40.900718+0000 mgr.y (mgr.44106) 382 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:42.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:40.900718+0000 mgr.y (mgr.44106) 382 : cluster [DBG] pgmap v260: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:44.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:42.901328+0000 mgr.y (mgr.44106) 383 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:44.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:42.901328+0000 mgr.y (mgr.44106) 383 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:44.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:42.901328+0000 mgr.y (mgr.44106) 383 : cluster [DBG] pgmap v261: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:46.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:44.901910+0000 mgr.y (mgr.44106) 384 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:46.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:44.901910+0000 mgr.y (mgr.44106) 384 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:46.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:45 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:44.901910+0000 mgr.y (mgr.44106) 384 : cluster [DBG] pgmap v262: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:48.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:46.902424+0000 mgr.y (mgr.44106) 385 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:48.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:47 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:46.902424+0000 mgr.y (mgr.44106) 385 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:48.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:46.902424+0000 mgr.y (mgr.44106) 385 : cluster [DBG] pgmap v263: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:50.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:48.902896+0000 mgr.y (mgr.44106) 386 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:50.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:49 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:48.902896+0000 mgr.y (mgr.44106) 386 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:50.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:49 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:48.902896+0000 mgr.y (mgr.44106) 386 : cluster [DBG] pgmap v264: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:52.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:51 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:50.903678+0000 mgr.y (mgr.44106) 387 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:52.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:51 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:50.903678+0000 mgr.y (mgr.44106) 387 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:52.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:51 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:50.903678+0000 mgr.y (mgr.44106) 387 : cluster [DBG] pgmap v265: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:54.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:52.904266+0000 mgr.y (mgr.44106) 388 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:54.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:52.904266+0000 mgr.y (mgr.44106) 388 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:54.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:53 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:52.904266+0000 mgr.y (mgr.44106) 388 : cluster [DBG] pgmap v266: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:56.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:54.905020+0000 mgr.y (mgr.44106) 389 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:56.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:55 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:54.905020+0000 mgr.y (mgr.44106) 389 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:56.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:55 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:54.905020+0000 mgr.y (mgr.44106) 389 : cluster [DBG] pgmap v267: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:58.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:33:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:56.905671+0000 mgr.y (mgr.44106) 390 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:58.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:33:57 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:56.905671+0000 mgr.y (mgr.44106) 390 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:33:58.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:33:57 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:56.905671+0000 mgr.y (mgr.44106) 390 : cluster [DBG] pgmap v268: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:00.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:33:58.906298+0000 mgr.y (mgr.44106) 391 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:00.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:00 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:33:58.906298+0000 mgr.y (mgr.44106) 391 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:00.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:00 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:33:58.906298+0000 mgr.y (mgr.44106) 391 : cluster [DBG] pgmap v269: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:02.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:00.907033+0000 mgr.y (mgr.44106) 392 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:02.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:02 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:00.907033+0000 mgr.y (mgr.44106) 392 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:02.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:02 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:00.907033+0000 mgr.y (mgr.44106) 392 : cluster [DBG] pgmap v270: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:04.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:02.907617+0000 mgr.y (mgr.44106) 393 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:04.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:04 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:02.907617+0000 mgr.y (mgr.44106) 393 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:04.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:04 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:02.907617+0000 mgr.y (mgr.44106) 393 : cluster [DBG] pgmap v271: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:06.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:04.908241+0000 mgr.y (mgr.44106) 394 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:06.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:06 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:04.908241+0000 mgr.y (mgr.44106) 394 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:06.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:06 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:04.908241+0000 mgr.y (mgr.44106) 394 : cluster [DBG] pgmap v272: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:08.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:06.908881+0000 mgr.y (mgr.44106) 395 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:08.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:06.908881+0000 mgr.y (mgr.44106) 395 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:08.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:08 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:06.908881+0000 mgr.y (mgr.44106) 395 : cluster [DBG] pgmap v273: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:10.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:08.909555+0000 mgr.y (mgr.44106) 396 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:10.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:10 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:08.909555+0000 mgr.y (mgr.44106) 396 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:10.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:10 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:08.909555+0000 mgr.y (mgr.44106) 396 : cluster [DBG] pgmap v274: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:11.853 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph orch ps' 2024-02-17T23:34:12.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:10.910070+0000 mgr.y (mgr.44106) 397 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:12.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:10.910070+0000 mgr.y (mgr.44106) 397 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:12.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:10.910070+0000 mgr.y (mgr.44106) 397 : cluster [DBG] pgmap v275: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:14.158 INFO:teuthology.orchestra.run.smithi005.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:alertmanager.a smithi005 running (2m) 2m ago 14m 14.6M - 0.23.0 ba2b418f427c 1d950c856fcc 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:grafana.a smithi080 running (107s) 102s ago 14m 25.3M - 8.3.5 dad864ee21e9 8467917cd34c 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.x smithi080 *:8443 running (8m) 102s ago 18m 385M - 16.2.14-548-g81bd20d6 823b921721f5 4db9cf00b8fa 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:mgr.y smithi005 *:8443 running (8m) 2m ago 20m 428M - 16.2.14-548-g81bd20d6 823b921721f5 5130266792fb 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:mon.a smithi005 running (7m) 2m ago 20m 63.2M 2048M 16.2.14-548-g81bd20d6 823b921721f5 879f1e7d963e 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:mon.b smithi080 running (7m) 102s ago 18m 52.4M 2048M 16.2.14-548-g81bd20d6 823b921721f5 337c3ebc36ca 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:mon.c smithi005 running (7m) 2m ago 19m 53.0M 2048M 16.2.14-548-g81bd20d6 823b921721f5 4e38df8f35b0 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.a smithi005 running (2m) 2m ago 15m 12.0M - 1.3.1 1dbe0e931976 40fcddf1502d 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:node-exporter.b smithi080 running (2m) 102s ago 15m 15.3M - 1.3.1 1dbe0e931976 60d93e84a643 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:osd.0 smithi005 running (6m) 2m ago 18m 47.8M 4096M 16.2.14-548-g81bd20d6 823b921721f5 601f1b6e410b 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:osd.1 smithi005 running (6m) 2m ago 17m 45.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 ff7b364ab038 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:osd.2 smithi005 running (5m) 2m ago 17m 40.1M 4096M 16.2.14-548-g81bd20d6 823b921721f5 f9b5c6109867 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:osd.3 smithi005 running (5m) 2m ago 17m 47.3M 4096M 16.2.14-548-g81bd20d6 823b921721f5 050f8c4e76bc 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:osd.4 smithi080 running (4m) 102s ago 16m 44.1M 4096M 16.2.14-548-g81bd20d6 823b921721f5 e57f1f319143 2024-02-17T23:34:14.159 INFO:teuthology.orchestra.run.smithi005.stdout:osd.5 smithi080 running (4m) 102s ago 16m 42.5M 4096M 16.2.14-548-g81bd20d6 823b921721f5 c515261f8fad 2024-02-17T23:34:14.160 INFO:teuthology.orchestra.run.smithi005.stdout:osd.6 smithi080 running (3m) 102s ago 16m 42.1M 4096M 16.2.14-548-g81bd20d6 823b921721f5 041e8ef3bef5 2024-02-17T23:34:14.160 INFO:teuthology.orchestra.run.smithi005.stdout:osd.7 smithi080 running (3m) 102s ago 15m 41.9M 4096M 16.2.14-548-g81bd20d6 823b921721f5 eedc239c7683 2024-02-17T23:34:14.160 INFO:teuthology.orchestra.run.smithi005.stdout:prometheus.a smithi080 running (2m) 102s ago 15m 44.7M - 2.33.4 514e6a882f6e 9f6c7049fa28 2024-02-17T23:34:14.160 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi005.dlhvju smithi005 running (2m) 2m ago 13m 38.8M - 16.2.14-548-g81bd20d6 823b921721f5 fa950e80dd4a 2024-02-17T23:34:14.160 INFO:teuthology.orchestra.run.smithi005.stdout:rgw.r.z.smithi080.qdwuig smithi080 running (2m) 102s ago 13m 38.2M - 16.2.14-548-g81bd20d6 823b921721f5 7521e0381946 2024-02-17T23:34:14.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:12.910589+0000 mgr.y (mgr.44106) 398 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:14.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:14 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:12.910589+0000 mgr.y (mgr.44106) 398 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:14.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:12.910589+0000 mgr.y (mgr.44106) 398 : cluster [DBG] pgmap v276: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:14.952 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph versions' 2024-02-17T23:34:15.375 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.144640+0000 mgr.y (mgr.44106) 399 : audit [DBG] from='client.44619 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:15.375 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.146504+0000 mon.c (mon.1) 460 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:34:15.375 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.146891+0000 mon.c (mon.1) 461 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:34:15.375 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.147219+0000 mon.c (mon.1) 462 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.147553+0000 mon.c (mon.1) 463 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.147860+0000 mon.c (mon.1) 464 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.148195+0000 mon.c (mon.1) 465 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.149880+0000 mon.c (mon.1) 466 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.150219+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.150542+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.150863+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:14.151184+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.144640+0000 mgr.y (mgr.44106) 399 : audit [DBG] from='client.44619 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.146504+0000 mon.c (mon.1) 460 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.146891+0000 mon.c (mon.1) 461 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:34:15.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.147219+0000 mon.c (mon.1) 462 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.147553+0000 mon.c (mon.1) 463 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.147860+0000 mon.c (mon.1) 464 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.148195+0000 mon.c (mon.1) 465 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.149880+0000 mon.c (mon.1) 466 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:34:15.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.150219+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.150542+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.150863+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:15 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:14.151184+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.144640+0000 mgr.y (mgr.44106) 399 : audit [DBG] from='client.44619 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:15.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.146504+0000 mon.c (mon.1) 460 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.a","key": "mon_memory_target"}]: dispatch 2024-02-17T23:34:15.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.146891+0000 mon.c (mon.1) 461 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.c","key": "mon_memory_target"}]: dispatch 2024-02-17T23:34:15.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.147219+0000 mon.c (mon.1) 462 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.0","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.147553+0000 mon.c (mon.1) 463 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.1","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.147860+0000 mon.c (mon.1) 464 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.2","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.148195+0000 mon.c (mon.1) 465 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.3","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.149880+0000 mon.c (mon.1) 466 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "mon.b","key": "mon_memory_target"}]: dispatch 2024-02-17T23:34:15.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.150219+0000 mon.c (mon.1) 467 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.4","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.150542+0000 mon.c (mon.1) 468 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.5","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.150863+0000 mon.c (mon.1) 469 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.6","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:15.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:14.151184+0000 mon.c (mon.1) 470 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config get","who": "osd.7","key": "osd_memory_target"}]: dispatch 2024-02-17T23:34:16.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:14.911298+0000 mgr.y (mgr.44106) 400 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:16.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:16 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:14.911298+0000 mgr.y (mgr.44106) 400 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:16.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:14.911298+0000 mgr.y (mgr.44106) 400 : cluster [DBG] pgmap v277: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:17.359 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:34:17.359 INFO:teuthology.orchestra.run.smithi005.stdout: "mon": { 2024-02-17T23:34:17.359 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 3 2024-02-17T23:34:17.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:34:17.359 INFO:teuthology.orchestra.run.smithi005.stdout: "mgr": { 2024-02-17T23:34:17.359 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:34:17.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:34:17.359 INFO:teuthology.orchestra.run.smithi005.stdout: "osd": { 2024-02-17T23:34:17.359 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 8 2024-02-17T23:34:17.359 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:34:17.360 INFO:teuthology.orchestra.run.smithi005.stdout: "mds": {}, 2024-02-17T23:34:17.360 INFO:teuthology.orchestra.run.smithi005.stdout: "rgw": { 2024-02-17T23:34:17.360 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 2 2024-02-17T23:34:17.360 INFO:teuthology.orchestra.run.smithi005.stdout: }, 2024-02-17T23:34:17.360 INFO:teuthology.orchestra.run.smithi005.stdout: "overall": { 2024-02-17T23:34:17.360 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)": 15 2024-02-17T23:34:17.360 INFO:teuthology.orchestra.run.smithi005.stdout: } 2024-02-17T23:34:17.360 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:34:18.116 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-02-17T23:34:18.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:16.911881+0000 mgr.y (mgr.44106) 401 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:18.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:17.357340+0000 mon.c (mon.1) 471 : audit [DBG] from='client.44625 172.21.15.5:0/1106265100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:34:18.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:16.911881+0000 mgr.y (mgr.44106) 401 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:18.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:18 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:17.357340+0000 mon.c (mon.1) 471 : audit [DBG] from='client.44625 172.21.15.5:0/1106265100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:34:18.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:16.911881+0000 mgr.y (mgr.44106) 401 : cluster [DBG] pgmap v278: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:18.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:17.357340+0000 mon.c (mon.1) 471 : audit [DBG] from='client.44625 172.21.15.5:0/1106265100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:34:20.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:18.912576+0000 mgr.y (mgr.44106) 402 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:20.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:20 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:18.912576+0000 mgr.y (mgr.44106) 402 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:20.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:18.912576+0000 mgr.y (mgr.44106) 402 : cluster [DBG] pgmap v279: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:20.539 INFO:teuthology.orchestra.run.smithi005.stdout:true 2024-02-17T23:34:21.281 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:20.526356+0000 mon.c (mon.1) 472 : audit [DBG] from='client.44631 172.21.15.5:0/3265321949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:34:21.281 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:21 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:20.526356+0000 mon.c (mon.1) 472 : audit [DBG] from='client.44631 172.21.15.5:0/3265321949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:34:21.296 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-02-17T23:34:21.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:20.526356+0000 mon.c (mon.1) 472 : audit [DBG] from='client.44631 172.21.15.5:0/3265321949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:34:22.280 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:20.913202+0000 mgr.y (mgr.44106) 403 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:22.281 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:22 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:20.913202+0000 mgr.y (mgr.44106) 403 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:22.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:20.913202+0000 mgr.y (mgr.44106) 403 : cluster [DBG] pgmap v280: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:23.354 INFO:teuthology.orchestra.run.smithi005.stdout: "ceph version 16.2.14-548-g81bd20d6 (81bd20d634209c7cb82c18be12b4b5a05643ebf1) pacific (stable)" 2024-02-17T23:34:24.106 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -e sha1=81bd20d634209c7cb82c18be12b4b5a05643ebf1 -- bash -c 'ceph orch ls | grep '"'"'^osd '"'"'' 2024-02-17T23:34:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:22.913890+0000 mgr.y (mgr.44106) 404 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:24.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:23.341899+0000 mon.c (mon.1) 473 : audit [DBG] from='client.44637 172.21.15.5:0/3957325608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:34:24.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:22.913890+0000 mgr.y (mgr.44106) 404 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:24.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:24 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:23.341899+0000 mon.c (mon.1) 473 : audit [DBG] from='client.44637 172.21.15.5:0/3957325608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:34:24.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:22.913890+0000 mgr.y (mgr.44106) 404 : cluster [DBG] pgmap v281: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:24.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:23.341899+0000 mon.c (mon.1) 473 : audit [DBG] from='client.44637 172.21.15.5:0/3957325608' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-02-17T23:34:26.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:24.914470+0000 mgr.y (mgr.44106) 405 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:26.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:26 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:24.914470+0000 mgr.y (mgr.44106) 405 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:26.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:24.914470+0000 mgr.y (mgr.44106) 405 : cluster [DBG] pgmap v282: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:26.458 INFO:teuthology.orchestra.run.smithi005.stdout:osd 8 2m ago - 2024-02-17T23:34:27.229 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-02-17T23:34:27.246 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi005.front.sepia.ceph.com 2024-02-17T23:34:27.247 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- bash -c 'ceph orch upgrade ls' 2024-02-17T23:34:28.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:26.441827+0000 mgr.y (mgr.44106) 406 : audit [DBG] from='client.44643 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:28.377 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:26.915063+0000 mgr.y (mgr.44106) 407 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:26.441827+0000 mgr.y (mgr.44106) 406 : audit [DBG] from='client.44643 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:28.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:28 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:26.915063+0000 mgr.y (mgr.44106) 407 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:28.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:26.441827+0000 mgr.y (mgr.44106) 406 : audit [DBG] from='client.44643 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:28.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:26.915063+0000 mgr.y (mgr.44106) 407 : cluster [DBG] pgmap v283: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:28.843854+0000 mon.c (mon.1) 474 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-17T23:34:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:28.844241+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:28.844381+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-17T23:34:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:28.844567+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:28.844837+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:28.844939+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:34:29.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:28.845222+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.378 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:28.845698+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:34:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:28.843854+0000 mon.c (mon.1) 474 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-17T23:34:29.378 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:28.844241+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:28.844381+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-17T23:34:29.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:28.844567+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:28.844837+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:28.844939+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:34:29.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:28.845222+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.379 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:29 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:28.845698+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:34:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:28.843854+0000 mon.c (mon.1) 474 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-17T23:34:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:28.844241+0000 mon.c (mon.1) 475 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:28.844381+0000 mon.a (mon.0) 623 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [7, 2]}]: dispatch 2024-02-17T23:34:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:28.844567+0000 mon.c (mon.1) 476 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:28.844837+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.d", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:28.844939+0000 mon.c (mon.1) 477 : audit [INF] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:34:29.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:28.845222+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.12", "id": [1, 5]}]: dispatch 2024-02-17T23:34:29.391 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:28.845698+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 2]}]: dispatch 2024-02-17T23:34:30.193 INFO:teuthology.orchestra.run.smithi005.stdout:{ 2024-02-17T23:34:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "image": "quay.io/ceph/ceph", 2024-02-17T23:34:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "registry": "quay.io", 2024-02-17T23:34:30.193 INFO:teuthology.orchestra.run.smithi005.stdout: "bare_image": "ceph/ceph", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "versions": [ 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "18.2.1", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "18.2.0", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "18.1.3", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "18.1.2", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "18.1.1", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "18.1.0", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "17.2.7", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "17.2.6", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "17.2.5", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "17.2.4", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "17.2.3", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "17.2.2", 2024-02-17T23:34:30.194 INFO:teuthology.orchestra.run.smithi005.stdout: "17.2.1", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "17.2.0", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "17.1.0", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.14", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.13", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.12", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.11", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.10", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.9", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.8", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.7", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.6", 2024-02-17T23:34:30.195 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.5", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.4", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.3", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.2", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.1", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.0", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.17", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.16", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.15", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.14", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.13", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.12", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.11", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.10", 2024-02-17T23:34:30.196 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.9", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.8", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.7", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.6", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.5", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.4", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.3", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.2", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.1", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "15.2.0", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.22", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.21", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.20", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.19", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.18", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.17", 2024-02-17T23:34:30.197 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.16", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.15", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.14", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.13", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.12", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.11", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.10", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.9", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.8", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.7", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.6", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.5", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.4", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.3", 2024-02-17T23:34:30.198 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.2", 2024-02-17T23:34:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.1", 2024-02-17T23:34:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: "14.2.0" 2024-02-17T23:34:30.199 INFO:teuthology.orchestra.run.smithi005.stdout: ] 2024-02-17T23:34:30.199 INFO:teuthology.orchestra.run.smithi005.stdout:} 2024-02-17T23:34:30.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:28.915496+0000 mgr.y (mgr.44106) 408 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:30.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:30 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:28.915496+0000 mgr.y (mgr.44106) 408 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:30.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:30 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:28.915496+0000 mgr.y (mgr.44106) 408 : cluster [DBG] pgmap v284: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:30.913 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph | grep 16.2.0' 2024-02-17T23:34:31.350 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:29.497941+0000 mgr.y (mgr.44106) 409 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:31.350 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:31 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:29.497941+0000 mgr.y (mgr.44106) 409 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:31.392 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:29.497941+0000 mgr.y (mgr.44106) 409 : audit [DBG] from='client.54601 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:32.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:30.916031+0000 mgr.y (mgr.44106) 410 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:32.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:32 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:30.916031+0000 mgr.y (mgr.44106) 410 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:32.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:30.916031+0000 mgr.y (mgr.44106) 410 : cluster [DBG] pgmap v285: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:32.330187+0000 mon.c (mon.1) 478 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:34:33.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:32.830337+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:34:33.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:32.330187+0000 mon.c (mon.1) 478 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:34:33.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:32.830337+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:34:33.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:32.330187+0000 mon.c (mon.1) 478 : audit [DBG] from='mgr.44106 172.21.15.5:0/1331937939' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-02-17T23:34:33.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:32.830337+0000 mon.a (mon.0) 627 : audit [INF] from='mgr.44106 ' entity='mgr.y' 2024-02-17T23:34:33.818 INFO:teuthology.orchestra.run.smithi005.stdout: "16.2.0", 2024-02-17T23:34:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:32.916583+0000 mgr.y (mgr.44106) 411 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:34.126 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:33.213359+0000 mgr.y (mgr.44106) 412 : audit [DBG] from='client.44655 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:32.916583+0000 mgr.y (mgr.44106) 411 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:34.126 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:34 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:33.213359+0000 mgr.y (mgr.44106) 412 : audit [DBG] from='client.44655 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:34.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:32.916583+0000 mgr.y (mgr.44106) 411 : cluster [DBG] pgmap v286: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:34.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:33.213359+0000 mgr.y (mgr.44106) 412 : audit [DBG] from='client.44655 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:34.516 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v15.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 -- bash -c 'ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2' 2024-02-17T23:34:36.227 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:34.917136+0000 mgr.y (mgr.44106) 413 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:36.227 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:36 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:34.917136+0000 mgr.y (mgr.44106) 413 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:36.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:34.917136+0000 mgr.y (mgr.44106) 413 : cluster [DBG] pgmap v287: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:37.228 INFO:teuthology.orchestra.run.smithi005.stdout: "v16.2.2", 2024-02-17T23:34:37.228 INFO:teuthology.orchestra.run.smithi005.stdout: "v16.2.2-20210505", 2024-02-17T23:34:37.945 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-02-17T23:34:37.958 INFO:tasks.cephadm:Teardown begin 2024-02-17T23:34:37.959 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-17T23:34:37.996 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-17T23:34:38.035 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-02-17T23:34:38.035 DEBUG:teuthology.orchestra.run.smithi005:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-17T23:34:38.056 DEBUG:teuthology.orchestra.run.smithi080:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-02-17T23:34:38.097 INFO:tasks.cephadm:Stopping all daemons... 2024-02-17T23:34:38.097 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-02-17T23:34:38.097 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a 2024-02-17T23:34:38.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: audit 2024-02-17T23:34:36.691713+0000 mgr.y (mgr.44106) 414 : audit [DBG] from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:38.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: cluster 2024-02-17T23:34:36.917652+0000 mgr.y (mgr.44106) 415 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:38.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: audit 2024-02-17T23:34:36.691713+0000 mgr.y (mgr.44106) 414 : audit [DBG] from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:38.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: cluster 2024-02-17T23:34:36.917652+0000 mgr.y (mgr.44106) 415 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:38.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:38 smithi005 systemd[1]: Stopping Ceph mon.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:34:38.377 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:38 smithi005 bash[77161]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon.a" found: no such container 2024-02-17T23:34:38.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: audit 2024-02-17T23:34:36.691713+0000 mgr.y (mgr.44106) 414 : audit [DBG] from='client.54613 -' entity='client.admin' cmd=[{"prefix": "orch upgrade ls", "image": "quay.io/ceph/ceph", "tags": true, "target": ["mon-mgr", ""]}]: dispatch 2024-02-17T23:34:38.390 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: cluster 2024-02-17T23:34:36.917652+0000 mgr.y (mgr.44106) 415 : cluster [DBG] pgmap v288: 129 pgs: 129 active+clean; 7.5 KiB data, 2.3 GiB used, 713 GiB / 715 GiB avail 2024-02-17T23:34:38.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:34:38.422+0000 7f11068ea700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-17T23:34:38.876 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:38 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a[60531]: debug 2024-02-17T23:34:38.422+0000 7f11068ea700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-02-17T23:34:39.376 INFO:journalctl@ceph.mon.a.smithi005.stdout:Feb 17 23:34:39 smithi005 bash[77201]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-a 2024-02-17T23:34:39.713 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.a.service' 2024-02-17T23:34:39.774 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:34:39.774 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-02-17T23:34:39.775 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-02-17T23:34:39.775 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.c 2024-02-17T23:34:40.080 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:39 smithi005 systemd[1]: Stopping Ceph mon.c for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:34:40.080 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:39 smithi005 bash[77320]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon.c" found: no such container 2024-02-17T23:34:40.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:34:40.073+0000 7f2150f50700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-17T23:34:40.376 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:40 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c[62007]: debug 2024-02-17T23:34:40.073+0000 7f2150f50700 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2024-02-17T23:34:40.876 INFO:journalctl@ceph.mon.c.smithi005.stdout:Feb 17 23:34:40 smithi005 bash[77362]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-c 2024-02-17T23:34:41.107 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.c.service' 2024-02-17T23:34:41.145 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:34:41.146 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-02-17T23:34:41.146 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-02-17T23:34:41.146 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.b 2024-02-17T23:34:41.466 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:41 smithi080 systemd[1]: Stopping Ceph mon.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:34:41.466 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:41 smithi080 bash[67864]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon.b" found: no such container 2024-02-17T23:34:41.466 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:34:41.462+0000 7f4b2af64700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-02-17T23:34:41.466 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b[54692]: debug 2024-02-17T23:34:41.462+0000 7f4b2af64700 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-02-17T23:34:42.164 INFO:journalctl@ceph.mon.b.smithi080.stdout:Feb 17 23:34:42 smithi080 bash[67906]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mon-b 2024-02-17T23:34:42.611 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mon.b.service' 2024-02-17T23:34:42.670 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:34:42.670 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-02-17T23:34:42.670 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-02-17T23:34:42.670 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y 2024-02-17T23:34:43.022 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:34:42 smithi005 systemd[1]: Stopping Ceph mgr.y for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:34:43.129 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:34:42 smithi005 bash[77507]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.y" found: no such container 2024-02-17T23:34:43.376 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:34:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y[58342]: debug 2024-02-17T23:34:43.019+0000 7f37095b1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-17T23:34:43.876 INFO:journalctl@ceph.mgr.y.smithi005.stdout:Feb 17 23:34:43 smithi005 bash[77547]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-y 2024-02-17T23:34:43.955 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.y.service' 2024-02-17T23:34:43.991 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:34:43.991 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-02-17T23:34:43.992 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-02-17T23:34:43.992 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.x 2024-02-17T23:34:44.390 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:34:44 smithi080 systemd[1]: Stopping Ceph mgr.x for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:34:44.390 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:34:44 smithi080 bash[68028]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr.x" found: no such container 2024-02-17T23:34:44.890 INFO:journalctl@ceph.mgr.x.smithi080.stdout:Feb 17 23:34:44 smithi080 bash[68068]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-mgr-x 2024-02-17T23:34:45.107 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@mgr.x.service' 2024-02-17T23:34:45.142 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:34:45.143 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-02-17T23:34:45.143 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-02-17T23:34:45.143 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.0 2024-02-17T23:34:45.509 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:34:45 smithi005 systemd[1]: Stopping Ceph osd.0 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:34:45.509 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:34:45 smithi005 bash[77666]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.0" found: no such container 2024-02-17T23:34:45.876 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:34:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-0[64418]: debug 2024-02-17T23:34:45.506+0000 7ff76f1c1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-17T23:34:45.876 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:34:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-0[64418]: debug 2024-02-17T23:34:45.506+0000 7ff76f1c1700 -1 osd.0 107 *** Got signal Terminated *** 2024-02-17T23:34:45.876 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:34:45 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-0[64418]: debug 2024-02-17T23:34:45.506+0000 7ff76f1c1700 -1 osd.0 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:34:51.376 INFO:journalctl@ceph.osd.0.smithi005.stdout:Feb 17 23:34:50 smithi005 bash[77707]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-0 2024-02-17T23:34:53.083 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.0.service' 2024-02-17T23:34:53.131 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:34:53.132 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-02-17T23:34:53.132 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-02-17T23:34:53.132 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.1 2024-02-17T23:34:53.376 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:34:53 smithi005 systemd[1]: Stopping Ceph osd.1 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:34:53.376 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:34:53 smithi005 bash[77947]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.1" found: no such container 2024-02-17T23:34:53.876 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:34:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-1[66193]: debug 2024-02-17T23:34:53.484+0000 7f52134b1700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-17T23:34:53.876 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:34:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-1[66193]: debug 2024-02-17T23:34:53.484+0000 7f52134b1700 -1 osd.1 107 *** Got signal Terminated *** 2024-02-17T23:34:53.877 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:34:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-1[66193]: debug 2024-02-17T23:34:53.484+0000 7f52134b1700 -1 osd.1 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:34:59.126 INFO:journalctl@ceph.osd.1.smithi005.stdout:Feb 17 23:34:58 smithi005 bash[77987]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-1 2024-02-17T23:35:00.685 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.1.service' 2024-02-17T23:35:00.731 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:35:00.732 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-02-17T23:35:00.732 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-02-17T23:35:00.732 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.2 2024-02-17T23:35:01.045 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:35:00 smithi005 systemd[1]: Stopping Ceph osd.2 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:35:01.046 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:35:00 smithi005 bash[78228]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.2" found: no such container 2024-02-17T23:35:01.376 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:35:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-2[67931]: debug 2024-02-17T23:35:01.042+0000 7fc41d337700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-17T23:35:01.376 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:35:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-2[67931]: debug 2024-02-17T23:35:01.042+0000 7fc41d337700 -1 osd.2 107 *** Got signal Terminated *** 2024-02-17T23:35:01.376 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:35:01 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-2[67931]: debug 2024-02-17T23:35:01.042+0000 7fc41d337700 -1 osd.2 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:35:06.876 INFO:journalctl@ceph.osd.2.smithi005.stdout:Feb 17 23:35:06 smithi005 bash[78266]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-2 2024-02-17T23:35:08.377 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.2.service' 2024-02-17T23:35:08.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:35:08.427 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-02-17T23:35:08.427 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-02-17T23:35:08.427 DEBUG:teuthology.orchestra.run.smithi005:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.3 2024-02-17T23:35:08.626 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:35:08 smithi005 systemd[1]: Stopping Ceph osd.3 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:35:08.626 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:35:08 smithi005 bash[78510]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.3" found: no such container 2024-02-17T23:35:09.126 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:35:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3[69671]: debug 2024-02-17T23:35:08.760+0000 7f16504ca700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-17T23:35:09.126 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:35:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3[69671]: debug 2024-02-17T23:35:08.760+0000 7f16504ca700 -1 osd.3 107 *** Got signal Terminated *** 2024-02-17T23:35:09.126 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:35:08 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3[69671]: debug 2024-02-17T23:35:08.760+0000 7f16504ca700 -1 osd.3 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:35:11.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:11.374+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:12.126 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:35:11 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3[69671]: debug 2024-02-17T23:35:11.662+0000 7f164d447700 -1 osd.3 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:46.555284+0000 front 2024-02-17T23:34:46.555397+0000 (oldest deadline 2024-02-17T23:35:11.255474+0000) 2024-02-17T23:35:12.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:11 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:11.784+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.167634+0000 front 2024-02-17T23:34:48.167447+0000 (oldest deadline 2024-02-17T23:35:11.067557+0000) 2024-02-17T23:35:12.753 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:12.424+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:13.126 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:35:12 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3[69671]: debug 2024-02-17T23:35:12.654+0000 7f164d447700 -1 osd.3 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:46.555284+0000 front 2024-02-17T23:34:46.555397+0000 (oldest deadline 2024-02-17T23:35:11.255474+0000) 2024-02-17T23:35:13.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:12 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:12.750+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.167634+0000 front 2024-02-17T23:34:48.167447+0000 (oldest deadline 2024-02-17T23:35:11.067557+0000) 2024-02-17T23:35:13.749 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:13.447+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:13.876 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:35:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3[69671]: debug 2024-02-17T23:35:13.655+0000 7f164d447700 -1 osd.3 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:46.555284+0000 front 2024-02-17T23:34:46.555397+0000 (oldest deadline 2024-02-17T23:35:11.255474+0000) 2024-02-17T23:35:13.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=warn ts=2024-02-17T23:35:13.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi005.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.5:8443: connect: connection refused" 2024-02-17T23:35:13.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:13 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=warn ts=2024-02-17T23:35:13.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-17T23:35:14.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:13.746+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.167634+0000 front 2024-02-17T23:34:48.167447+0000 (oldest deadline 2024-02-17T23:35:11.067557+0000) 2024-02-17T23:35:14.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:13.981+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:14.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:13 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:13.866+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:14.376 INFO:journalctl@ceph.osd.3.smithi005.stdout:Feb 17 23:35:14 smithi005 bash[78551]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-3 2024-02-17T23:35:14.769 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:14.409+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:15.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:14.859+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:15.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:14.941+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:15.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:14 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:14.766+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.167634+0000 front 2024-02-17T23:34:48.167447+0000 (oldest deadline 2024-02-17T23:35:11.067557+0000) 2024-02-17T23:35:15.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:15.359+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:16.051 DEBUG:teuthology.orchestra.run.smithi005:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.3.service' 2024-02-17T23:35:16.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:35:16.094 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-02-17T23:35:16.094 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-02-17T23:35:16.094 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.4 2024-02-17T23:35:16.128 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:15.785+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.167634+0000 front 2024-02-17T23:34:48.167447+0000 (oldest deadline 2024-02-17T23:35:11.067557+0000) 2024-02-17T23:35:16.129 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:15.870+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:16.129 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:15 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:15.968+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:16.390 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:16 smithi080 systemd[1]: Stopping Ceph osd.4 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:35:16.390 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:16 smithi080 bash[68200]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.4" found: no such container 2024-02-17T23:35:16.390 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:16.346+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:16.833 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:16.432+0000 7effb0ba3700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-17T23:35:16.834 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:16.432+0000 7effb0ba3700 -1 osd.4 107 *** Got signal Terminated *** 2024-02-17T23:35:16.834 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:16.432+0000 7effb0ba3700 -1 osd.4 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:35:17.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:16.830+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.167634+0000 front 2024-02-17T23:34:48.167447+0000 (oldest deadline 2024-02-17T23:35:11.067557+0000) 2024-02-17T23:35:17.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:16 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:16.837+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:17.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:17.005+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:17.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:17.353+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:18.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:17.849+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.167634+0000 front 2024-02-17T23:34:48.167447+0000 (oldest deadline 2024-02-17T23:35:11.067557+0000) 2024-02-17T23:35:18.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:18.001+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:18.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:17 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:17.819+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:18.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:18.346+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:19.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:18.834+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:19.141 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:18.971+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:19.141 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:18.841+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.167634+0000 front 2024-02-17T23:34:48.167447+0000 (oldest deadline 2024-02-17T23:35:11.067557+0000) 2024-02-17T23:35:19.141 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:18 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:18.841+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.968439+0000 front 2024-02-17T23:34:56.968449+0000 (oldest deadline 2024-02-17T23:35:18.668337+0000) 2024-02-17T23:35:19.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:19.334+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:20.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:19.840+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.167634+0000 front 2024-02-17T23:34:48.167447+0000 (oldest deadline 2024-02-17T23:35:11.067557+0000) 2024-02-17T23:35:20.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:19.840+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.968439+0000 front 2024-02-17T23:34:56.968449+0000 (oldest deadline 2024-02-17T23:35:18.668337+0000) 2024-02-17T23:35:20.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:19.816+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:20.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:19.816+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:54.711147+0000 front 2024-02-17T23:34:54.711024+0000 (oldest deadline 2024-02-17T23:35:19.410941+0000) 2024-02-17T23:35:20.141 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:19.938+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:20.141 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:19 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:19.938+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:20.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:20.302+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:21.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:20.843+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:21.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:20.843+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:54.711147+0000 front 2024-02-17T23:34:54.711024+0000 (oldest deadline 2024-02-17T23:35:19.410941+0000) 2024-02-17T23:35:21.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:20.844+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.167634+0000 front 2024-02-17T23:34:48.167447+0000 (oldest deadline 2024-02-17T23:35:11.067557+0000) 2024-02-17T23:35:21.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4[57070]: debug 2024-02-17T23:35:20.844+0000 7effabb1c700 -1 osd.4 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.968439+0000 front 2024-02-17T23:34:56.968449+0000 (oldest deadline 2024-02-17T23:35:18.668337+0000) 2024-02-17T23:35:21.141 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:20.948+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:21.141 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:20 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:20.948+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:21.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:21.339+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:22.140 INFO:journalctl@ceph.osd.4.smithi080.stdout:Feb 17 23:35:22 smithi080 bash[68239]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-4 2024-02-17T23:35:22.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:21.822+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:22.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:21.822+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:54.711147+0000 front 2024-02-17T23:34:54.711024+0000 (oldest deadline 2024-02-17T23:35:19.410941+0000) 2024-02-17T23:35:22.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:21.995+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:22.141 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:21 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:21.995+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:22.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:22.375+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:22.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:22.375+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:23.013 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:22.818+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:23.013 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:22 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:22.818+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:54.711147+0000 front 2024-02-17T23:34:54.711024+0000 (oldest deadline 2024-02-17T23:35:19.410941+0000) 2024-02-17T23:35:23.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:23.010+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:23.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:23.010+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:23.790 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:23.396+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:23.790 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:23.396+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:23.818 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.4.service' 2024-02-17T23:35:23.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=error ts=2024-02-17T23:35:23.520Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi005.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.5:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-17T23:35:23.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=warn ts=2024-02-17T23:35:23.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi005.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.5:8443: connect: connection refused" 2024-02-17T23:35:23.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:23 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=warn ts=2024-02-17T23:35:23.522Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-17T23:35:23.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:35:23.899 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-02-17T23:35:23.899 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-02-17T23:35:23.899 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.5 2024-02-17T23:35:24.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:23.972+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:24.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:23.972+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:24.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:23.787+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:24.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:23 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:23.787+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:54.711147+0000 front 2024-02-17T23:34:54.711024+0000 (oldest deadline 2024-02-17T23:35:19.410941+0000) 2024-02-17T23:35:24.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:23 smithi080 systemd[1]: Stopping Ceph osd.5 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:35:24.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:23 smithi080 bash[68479]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.5" found: no such container 2024-02-17T23:35:24.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:24.433+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:24.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:24.433+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:24.640 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:24.253+0000 7f761e131700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-17T23:35:24.640 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:24.253+0000 7f761e131700 -1 osd.5 107 *** Got signal Terminated *** 2024-02-17T23:35:24.641 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:24.253+0000 7f761e131700 -1 osd.5 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:35:25.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:25.016+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:25.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:25.016+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:25.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:24.800+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:25.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:24 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:24.800+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:54.711147+0000 front 2024-02-17T23:34:54.711024+0000 (oldest deadline 2024-02-17T23:35:19.410941+0000) 2024-02-17T23:35:25.811 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:25.438+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:25.811 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:25.438+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:26.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:25.808+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:26.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:25.809+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:54.711147+0000 front 2024-02-17T23:34:54.711024+0000 (oldest deadline 2024-02-17T23:35:19.410941+0000) 2024-02-17T23:35:26.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:25.988+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:26.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:25 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:25.988+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:26.826 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:26.440+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:26.826 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:26.440+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:27.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:26.824+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:27.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:26.824+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:54.711147+0000 front 2024-02-17T23:34:54.711024+0000 (oldest deadline 2024-02-17T23:35:19.410941+0000) 2024-02-17T23:35:27.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:26.980+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:27.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:26 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:26.980+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:27.874 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:27.453+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:27.874 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:27.453+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:27.874 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:27.453+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:28.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:27.872+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:28.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:27.872+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:54.711147+0000 front 2024-02-17T23:34:54.711024+0000 (oldest deadline 2024-02-17T23:35:19.410941+0000) 2024-02-17T23:35:28.141 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:27.997+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:28.141 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:27 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:27.997+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:28.878 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:28.477+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:28.878 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:28.477+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:28.878 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:28.477+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:29.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:28.876+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:49.009685+0000 front 2024-02-17T23:34:49.009609+0000 (oldest deadline 2024-02-17T23:35:13.109741+0000) 2024-02-17T23:35:29.140 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5[58804]: debug 2024-02-17T23:35:28.876+0000 7f761b0ae700 -1 osd.5 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:54.711147+0000 front 2024-02-17T23:34:54.711024+0000 (oldest deadline 2024-02-17T23:35:19.410941+0000) 2024-02-17T23:35:29.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:28.958+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:29.140 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:28 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:28.958+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:29.793 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:29.482+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:29.793 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:29.482+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:29.794 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:29.482+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:30.141 INFO:journalctl@ceph.osd.5.smithi080.stdout:Feb 17 23:35:29 smithi080 bash[68519]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-5 2024-02-17T23:35:30.141 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:29.968+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:30.141 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:29 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:29.968+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:30.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:30 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:30.495+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:30.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:30 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:30.495+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:30.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:30 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:30.495+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:31.251 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:30 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:30.937+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:31.251 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:30 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:30.937+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:31.613 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:31.463+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:31.613 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:31.463+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:31.613 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:31.463+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:31.621 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.5.service' 2024-02-17T23:35:31.660 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:35:31.660 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-02-17T23:35:31.660 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-02-17T23:35:31.660 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.6 2024-02-17T23:35:31.890 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:31 smithi080 systemd[1]: Stopping Ceph osd.6 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:35:31.890 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:31 smithi080 bash[68760]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.6" found: no such container 2024-02-17T23:35:32.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:31.975+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:32.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:31.975+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:32.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:31.975+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:06.017559+0000 front 2024-02-17T23:35:06.017485+0000 (oldest deadline 2024-02-17T23:35:31.917398+0000) 2024-02-17T23:35:32.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:31.998+0000 7fe32492a700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-17T23:35:32.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:31.998+0000 7fe32492a700 -1 osd.6 107 *** Got signal Terminated *** 2024-02-17T23:35:32.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:31 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:31.998+0000 7fe32492a700 -1 osd.6 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:35:32.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:32.421+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:32.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:32.421+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:32.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:32.421+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:33.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:32.977+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:33.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:32.977+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:33.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:32 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:32.977+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:06.017559+0000 front 2024-02-17T23:35:06.017485+0000 (oldest deadline 2024-02-17T23:35:31.917398+0000) 2024-02-17T23:35:33.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=error ts=2024-02-17T23:35:33.521Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://smithi005.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.5:8443: connect: connection refused" 2024-02-17T23:35:33.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=warn ts=2024-02-17T23:35:33.522Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi005.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.5:8443: connect: connection refused" 2024-02-17T23:35:33.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:33 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=warn ts=2024-02-17T23:35:33.522Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-17T23:35:33.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:33.413+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:33.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:33.413+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:33.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:33 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:33.413+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:34.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:34.006+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:34.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:34.006+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:34.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:34.006+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:06.017559+0000 front 2024-02-17T23:35:06.017485+0000 (oldest deadline 2024-02-17T23:35:31.917398+0000) 2024-02-17T23:35:34.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:34.419+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:34.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:34.419+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:34.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:34.419+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:35.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:34.972+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:35.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:34.972+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:35.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:34.972+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:06.017559+0000 front 2024-02-17T23:35:06.017485+0000 (oldest deadline 2024-02-17T23:35:31.917398+0000) 2024-02-17T23:35:35.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:34 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:34.972+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:13.018285+0000 front 2024-02-17T23:35:13.018276+0000 (oldest deadline 2024-02-17T23:35:34.118270+0000) 2024-02-17T23:35:35.891 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:35.436+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:35.891 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:35.436+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:35.891 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:35.436+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:35.891 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:35.436+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:12.143342+0000 front 2024-02-17T23:35:12.143327+0000 (oldest deadline 2024-02-17T23:35:34.443151+0000) 2024-02-17T23:35:36.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:35.971+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:36.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:35.971+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:36.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:35.971+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:06.017559+0000 front 2024-02-17T23:35:06.017485+0000 (oldest deadline 2024-02-17T23:35:31.917398+0000) 2024-02-17T23:35:36.390 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:35 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:35.971+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:13.018285+0000 front 2024-02-17T23:35:13.018276+0000 (oldest deadline 2024-02-17T23:35:34.118270+0000) 2024-02-17T23:35:36.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:36.412+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:36.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:36.412+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:36.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:36.412+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:36.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:36.412+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:12.143342+0000 front 2024-02-17T23:35:12.143327+0000 (oldest deadline 2024-02-17T23:35:34.443151+0000) 2024-02-17T23:35:37.323 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:36.928+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:48.015011+0000 front 2024-02-17T23:34:48.014919+0000 (oldest deadline 2024-02-17T23:35:13.914690+0000) 2024-02-17T23:35:37.323 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:36.928+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.215686+0000 front 2024-02-17T23:34:56.215626+0000 (oldest deadline 2024-02-17T23:35:19.115631+0000) 2024-02-17T23:35:37.323 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:36.928+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:06.017559+0000 front 2024-02-17T23:35:06.017485+0000 (oldest deadline 2024-02-17T23:35:31.917398+0000) 2024-02-17T23:35:37.324 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:36 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6[60543]: debug 2024-02-17T23:35:36.928+0000 7fe31f0a2700 -1 osd.6 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:13.018285+0000 front 2024-02-17T23:35:13.018276+0000 (oldest deadline 2024-02-17T23:35:34.118270+0000) 2024-02-17T23:35:37.580 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:37.452+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:37.580 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:37.452+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:37.581 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:37.452+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:37.581 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:37 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:37.452+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:12.143342+0000 front 2024-02-17T23:35:12.143327+0000 (oldest deadline 2024-02-17T23:35:34.443151+0000) 2024-02-17T23:35:37.890 INFO:journalctl@ceph.osd.6.smithi080.stdout:Feb 17 23:35:37 smithi080 bash[68802]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-6 2024-02-17T23:35:38.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:38.424+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:38.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:38.424+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:38.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:38.424+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:38.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:38 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:38.424+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:12.143342+0000 front 2024-02-17T23:35:12.143327+0000 (oldest deadline 2024-02-17T23:35:34.443151+0000) 2024-02-17T23:35:39.557 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:39.410+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:39.558 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:39.410+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:39.558 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:39.410+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:39.558 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:39.410+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:12.143342+0000 front 2024-02-17T23:35:12.143327+0000 (oldest deadline 2024-02-17T23:35:34.443151+0000) 2024-02-17T23:35:39.565 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.6.service' 2024-02-17T23:35:39.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:35:39.605 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-02-17T23:35:39.605 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-02-17T23:35:39.605 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.7 2024-02-17T23:35:39.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:39 smithi080 systemd[1]: Stopping Ceph osd.7 for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:35:39.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:39 smithi080 bash[69039]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd.7" found: no such container 2024-02-17T23:35:40.391 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:39.967+0000 7f51ef7df700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-02-17T23:35:40.391 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:39.967+0000 7f51ef7df700 -1 osd.7 107 *** Got signal Terminated *** 2024-02-17T23:35:40.391 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:39 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:39.967+0000 7f51ef7df700 -1 osd.7 107 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-02-17T23:35:40.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:40.406+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:40.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:40.406+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:40.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:40.406+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:40.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:40 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:40.406+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:12.143342+0000 front 2024-02-17T23:35:12.143327+0000 (oldest deadline 2024-02-17T23:35:34.443151+0000) 2024-02-17T23:35:41.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:41.452+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:41.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:41.452+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:41.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:41.452+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:41.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:41 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:41.452+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:12.143342+0000 front 2024-02-17T23:35:12.143327+0000 (oldest deadline 2024-02-17T23:35:34.443151+0000) 2024-02-17T23:35:42.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:42.426+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:42.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:42.426+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:42.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:42.426+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:42.890 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:42 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:42.426+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:12.143342+0000 front 2024-02-17T23:35:12.143327+0000 (oldest deadline 2024-02-17T23:35:34.443151+0000) 2024-02-17T23:35:43.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:43.383+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:43.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:43.383+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:43.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:43.383+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:43.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:43.383+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:12.143342+0000 front 2024-02-17T23:35:12.143327+0000 (oldest deadline 2024-02-17T23:35:34.443151+0000) 2024-02-17T23:35:43.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:43 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:43.383+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.80:6804 osd.4 since back 2024-02-17T23:35:19.044423+0000 front 2024-02-17T23:35:19.044502+0000 (oldest deadline 2024-02-17T23:35:43.144438+0000) 2024-02-17T23:35:43.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=error ts=2024-02-17T23:35:43.522Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi005.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.5:8443: connect: connection refused" 2024-02-17T23:35:43.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=warn ts=2024-02-17T23:35:43.523Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi005.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.5:8443: connect: connection refused" 2024-02-17T23:35:43.876 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:43 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=warn ts=2024-02-17T23:35:43.523Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-17T23:35:44.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:44 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:44.373+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6806 osd.0 since back 2024-02-17T23:34:45.040840+0000 front 2024-02-17T23:34:45.040924+0000 (oldest deadline 2024-02-17T23:35:10.940908+0000) 2024-02-17T23:35:44.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:44 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:44.373+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6814 osd.1 since back 2024-02-17T23:34:56.241918+0000 front 2024-02-17T23:34:56.241930+0000 (oldest deadline 2024-02-17T23:35:21.541882+0000) 2024-02-17T23:35:44.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:44 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:44.373+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6822 osd.2 since back 2024-02-17T23:35:01.542447+0000 front 2024-02-17T23:35:01.542504+0000 (oldest deadline 2024-02-17T23:35:26.842459+0000) 2024-02-17T23:35:44.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:44 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:44.373+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.5:6830 osd.3 since back 2024-02-17T23:35:12.143342+0000 front 2024-02-17T23:35:12.143327+0000 (oldest deadline 2024-02-17T23:35:34.443151+0000) 2024-02-17T23:35:44.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:44 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7[62249]: debug 2024-02-17T23:35:44.373+0000 7f51ec75c700 -1 osd.7 107 heartbeat_check: no reply from 172.21.15.80:6804 osd.4 since back 2024-02-17T23:35:19.044423+0000 front 2024-02-17T23:35:19.044502+0000 (oldest deadline 2024-02-17T23:35:43.144438+0000) 2024-02-17T23:35:45.640 INFO:journalctl@ceph.osd.7.smithi080.stdout:Feb 17 23:35:45 smithi080 bash[69080]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-osd-7 2024-02-17T23:35:47.217 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@osd.7.service' 2024-02-17T23:35:47.257 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:35:47.258 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-02-17T23:35:47.258 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-02-17T23:35:47.258 DEBUG:teuthology.orchestra.run.smithi080:> sudo systemctl stop ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@prometheus.a 2024-02-17T23:35:47.596 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 systemd[1]: Stopping Ceph prometheus.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:35:47.596 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 bash[69320]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus.a" found: no such container 2024-02-17T23:35:47.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.594Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-02-17T23:35:47.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.594Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-02-17T23:35:47.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.594Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-02-17T23:35:47.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.594Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-02-17T23:35:47.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.594Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-02-17T23:35:47.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.594Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-02-17T23:35:47.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.594Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-02-17T23:35:47.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.595Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-02-17T23:35:47.890 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.595Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-02-17T23:35:47.891 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.595Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-02-17T23:35:47.891 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.595Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-02-17T23:35:47.891 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:47 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a[66096]: ts=2024-02-17T23:35:47.595Z caller=main.go:1066 level=info msg="See you next time!" 2024-02-17T23:35:48.390 INFO:journalctl@ceph.prometheus.a.smithi080.stdout:Feb 17 23:35:48 smithi080 bash[69362]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-prometheus-a 2024-02-17T23:35:48.501 DEBUG:teuthology.orchestra.run.smithi080:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@prometheus.a.service' 2024-02-17T23:35:48.535 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-02-17T23:35:48.535 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-02-17T23:35:48.536 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-17T23:35:48.675 INFO:teuthology.orchestra.run.smithi005.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2024-02-17T23:35:48.675 INFO:teuthology.orchestra.run.smithi005.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2024-02-17T23:35:48.675 INFO:teuthology.orchestra.run.smithi005.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2024-02-17T23:35:48.675 INFO:teuthology.orchestra.run.smithi005.stderr: [--retry RETRY] 2024-02-17T23:35:48.675 INFO:teuthology.orchestra.run.smithi005.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install} 2024-02-17T23:35:48.675 INFO:teuthology.orchestra.run.smithi005.stderr: ... 2024-02-17T23:35:48.675 INFO:teuthology.orchestra.run.smithi005.stderr:cephadm: error: unrecognized arguments: --keep-logs 2024-02-17T23:35:48.685 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-17T23:35:48.685 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 --force --keep-logs 2024-02-17T23:35:48.805 INFO:teuthology.orchestra.run.smithi080.stderr:usage: cephadm [-h] [--image IMAGE] [--docker] [--data-dir DATA_DIR] 2024-02-17T23:35:48.805 INFO:teuthology.orchestra.run.smithi080.stderr: [--log-dir LOG_DIR] [--logrotate-dir LOGROTATE_DIR] 2024-02-17T23:35:48.805 INFO:teuthology.orchestra.run.smithi080.stderr: [--unit-dir UNIT_DIR] [--verbose] [--timeout TIMEOUT] 2024-02-17T23:35:48.805 INFO:teuthology.orchestra.run.smithi080.stderr: [--retry RETRY] 2024-02-17T23:35:48.806 INFO:teuthology.orchestra.run.smithi080.stderr: {version,pull,inspect-image,ls,list-networks,adopt,rm-daemon,rm-cluster,run,shell,enter,ceph-volume,unit,logs,bootstrap,deploy,check-host,prepare-host,add-repo,rm-repo,install} 2024-02-17T23:35:48.806 INFO:teuthology.orchestra.run.smithi080.stderr: ... 2024-02-17T23:35:48.806 INFO:teuthology.orchestra.run.smithi080.stderr:cephadm: error: unrecognized arguments: --keep-logs 2024-02-17T23:35:48.814 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-02-17T23:35:48.815 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-17T23:35:48.844 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-02-17T23:35:48.870 INFO:tasks.cephadm:Archiving crash dumps... 2024-02-17T23:35:48.872 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822/remote/ubuntu@smithi005.front.sepia.ceph.com/crash 2024-02-17T23:35:48.873 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/crash -- . 2024-02-17T23:35:48.918 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822/remote/ubuntu@smithi080.front.sepia.ceph.com/crash 2024-02-17T23:35:48.919 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/lib/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/crash -- . 2024-02-17T23:35:48.972 INFO:tasks.cephadm:Checking cluster log for badness... 2024-02-17T23:35:48.973 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v 'mons down' | egrep -v 'pg inactive' | egrep -v 'out of quorum' | egrep -v '\(OSD_' | egrep -v 'osds down' | egrep -v 'osd down' | head -n 1 2024-02-17T23:35:49.004 INFO:teuthology.orchestra.run.smithi005.stdout:2024-02-17T23:18:12.187714+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: 1 stray daemons(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-17T23:35:49.005 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-02-17T23:35:49.005 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[SEC\]' /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v 'mons down' | egrep -v 'pg inactive' | egrep -v 'out of quorum' | egrep -v '\(OSD_' | egrep -v 'osds down' | egrep -v 'osd down' | head -n 1 2024-02-17T23:35:49.076 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[ERR\]' /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v 'mons down' | egrep -v 'pg inactive' | egrep -v 'out of quorum' | egrep -v '\(OSD_' | egrep -v 'osds down' | egrep -v 'osd down' | head -n 1 2024-02-17T23:35:49.146 DEBUG:teuthology.orchestra.run.smithi005:> sudo egrep '\[WRN\]' /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MON_DOWN\)' | egrep -v '\(PG_' | egrep -v 'mons down' | egrep -v 'pg inactive' | egrep -v 'out of quorum' | egrep -v '\(OSD_' | egrep -v 'osds down' | egrep -v 'osd down' | head -n 1 2024-02-17T23:35:49.217 INFO:teuthology.orchestra.run.smithi005.stdout:2024-02-17T23:18:12.187714+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: 1 stray daemons(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-02-17T23:35:49.217 INFO:tasks.cephadm:Compressing logs... 2024-02-17T23:35:49.218 DEBUG:teuthology.orchestra.run.smithi005:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-17T23:35:49.260 DEBUG:teuthology.orchestra.run.smithi080:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-02-17T23:35:49.286 INFO:teuthology.orchestra.run.smithi005.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-17T23:35:49.286 INFO:teuthology.orchestra.run.smithi005.stderr:: No such file or directory 2024-02-17T23:35:49.286 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-17T23:35:49.286 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.2.log 2024-02-17T23:35:49.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mgr.y.log 2024-02-17T23:35:49.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-volume.log: /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-17T23:35:49.286 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-17T23:35:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.audit.log: /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.cephadm.log: 90.4% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-17T23:35:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.3.log 2024-02-17T23:35:49.288 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.0.log 2024-02-17T23:35:49.289 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.3.log: /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.0.log: 91.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-17T23:35:49.289 INFO:teuthology.orchestra.run.smithi080.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-02-17T23:35:49.289 INFO:teuthology.orchestra.run.smithi080.stderr:: No such file or directory 2024-02-17T23:35:49.289 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.6.log 2024-02-17T23:35:49.289 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-volume.log 2024-02-17T23:35:49.290 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mon.a.log 2024-02-17T23:35:49.290 INFO:teuthology.orchestra.run.smithi005.stderr: 91.7% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-17T23:35:49.291 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.audit.log 2024-02-17T23:35:49.291 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.6.log: /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.cephadm.log 2024-02-17T23:35:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.7.log 2024-02-17T23:35:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mgr.x.log 2024-02-17T23:35:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.7.log: 82.5% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.cephadm.log.gz 2024-02-17T23:35:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mon.b.log 2024-02-17T23:35:49.292 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mon.b.log: 91.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-02-17T23:35:49.293 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mon.c.log 2024-02-17T23:35:49.293 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-client.rgw.r.z.smithi080.qdwuig.log 2024-02-17T23:35:49.294 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-client.rgw.r.z.smithi080.qdwuig.log: 70.9% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-client.rgw.r.z.smithi080.qdwuig.log.gz 2024-02-17T23:35:49.294 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.log 2024-02-17T23:35:49.294 INFO:teuthology.orchestra.run.smithi080.stderr: 91.5% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-volume.log.gz 2024-02-17T23:35:49.295 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.4.log 2024-02-17T23:35:49.296 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.log 2024-02-17T23:35:49.297 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.log: /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.4.log: 87.9% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-17T23:35:49.298 INFO:teuthology.orchestra.run.smithi080.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.5.log 2024-02-17T23:35:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.log: 93.2% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.log.gz 2024-02-17T23:35:49.301 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-client.rgw.r.z.smithi005.dlhvju.log 2024-02-17T23:35:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-client.rgw.r.z.smithi005.dlhvju.log: 71.6% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-client.rgw.r.z.smithi005.dlhvju.log.gz 2024-02-17T23:35:49.302 INFO:teuthology.orchestra.run.smithi005.stderr:gzip -5 --verbose -- /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.1.log 2024-02-17T23:35:49.306 INFO:teuthology.orchestra.run.smithi080.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.5.log: 94.9% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-17T23:35:49.320 INFO:teuthology.orchestra.run.smithi005.stderr:/var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.1.log: 96.0% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph.audit.log.gz 2024-02-17T23:35:49.327 INFO:teuthology.orchestra.run.smithi080.stderr: 90.1% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mgr.x.log.gz 2024-02-17T23:35:49.615 INFO:teuthology.orchestra.run.smithi005.stderr: 91.5% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mgr.y.log.gz 2024-02-17T23:35:49.937 INFO:teuthology.orchestra.run.smithi080.stderr: 93.0% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mon.b.log.gz 2024-02-17T23:35:49.947 INFO:teuthology.orchestra.run.smithi080.stderr: 93.2% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.6.log.gz 2024-02-17T23:35:49.965 INFO:teuthology.orchestra.run.smithi005.stderr: 93.2% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.2.log.gz 2024-02-17T23:35:50.036 INFO:teuthology.orchestra.run.smithi080.stderr: 93.8% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.7.log.gz 2024-02-17T23:35:50.044 INFO:teuthology.orchestra.run.smithi005.stderr: 93.3% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mon.c.log.gz 2024-02-17T23:35:50.138 INFO:teuthology.orchestra.run.smithi005.stderr: 93.4% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.0.log.gz 2024-02-17T23:35:50.153 INFO:teuthology.orchestra.run.smithi080.stderr: 93.6% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.4.log.gz 2024-02-17T23:35:50.247 INFO:teuthology.orchestra.run.smithi080.stderr: 93.4% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.5.log.gz 2024-02-17T23:35:50.248 INFO:teuthology.orchestra.run.smithi080.stderr: 2024-02-17T23:35:50.248 INFO:teuthology.orchestra.run.smithi080.stderr:real 0m0.970s 2024-02-17T23:35:50.249 INFO:teuthology.orchestra.run.smithi080.stderr:user 0m3.774s 2024-02-17T23:35:50.249 INFO:teuthology.orchestra.run.smithi080.stderr:sys 0m0.164s 2024-02-17T23:35:50.258 INFO:teuthology.orchestra.run.smithi005.stderr: 91.1% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-mon.a.log.gz 2024-02-17T23:35:50.320 INFO:teuthology.orchestra.run.smithi005.stderr: 93.6% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.1.log.gz 2024-02-17T23:35:50.370 INFO:teuthology.orchestra.run.smithi005.stderr: 93.5% -- replaced with /var/log/ceph/1ffcdf7e-cdea-11ee-95ba-87774f69a715/ceph-osd.3.log.gz 2024-02-17T23:35:50.371 INFO:teuthology.orchestra.run.smithi005.stderr: 2024-02-17T23:35:50.371 INFO:teuthology.orchestra.run.smithi005.stderr:real 0m1.097s 2024-02-17T23:35:50.372 INFO:teuthology.orchestra.run.smithi005.stderr:user 0m5.535s 2024-02-17T23:35:50.372 INFO:teuthology.orchestra.run.smithi005.stderr:sys 0m0.207s 2024-02-17T23:35:50.372 INFO:tasks.cephadm:Archiving logs... 2024-02-17T23:35:50.372 DEBUG:teuthology.misc:Transferring archived files from smithi005:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822/remote/ubuntu@smithi005.front.sepia.ceph.com/log 2024-02-17T23:35:50.373 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-17T23:35:51.110 DEBUG:teuthology.misc:Transferring archived files from smithi080:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822/remote/ubuntu@smithi080.front.sepia.ceph.com/log 2024-02-17T23:35:51.111 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /var/log/ceph -- . 2024-02-17T23:35:51.649 INFO:tasks.cephadm:Removing cluster... 2024-02-17T23:35:51.649 DEBUG:teuthology.orchestra.run.smithi005:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 --force 2024-02-17T23:35:52.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:35:52 smithi005 systemd[1]: Stopping Ceph node-exporter.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:35:52.626 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:35:52 smithi005 bash[79274]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter.a" found: no such container 2024-02-17T23:35:53.524 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:35:53 smithi005 bash[79312]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-a 2024-02-17T23:35:53.780 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:35:53 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-02-17T23:35:53.781 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=error ts=2024-02-17T23:35:53.522Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://smithi005.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.5:8443: connect: connection refused; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-17T23:35:53.781 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=warn ts=2024-02-17T23:35:53.524Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi005.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.5:8443: connect: connection refused" 2024-02-17T23:35:53.781 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:53 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=warn ts=2024-02-17T23:35:53.525Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://smithi080.front.sepia.ceph.com:8443/api/prometheus_receiver\": dial tcp 172.21.15.80:8443: connect: connection refused" 2024-02-17T23:35:54.126 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:35:53 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@node-exporter.a.service: Failed with result 'exit-code'. 2024-02-17T23:35:54.126 INFO:journalctl@ceph.node-exporter.a.smithi005.stdout:Feb 17 23:35:53 smithi005 systemd[1]: Stopped Ceph node-exporter.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:35:54.127 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:53 smithi005 systemd[1]: Stopping Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:35:54.127 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:53 smithi005 bash[79413]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager.a" found: no such container 2024-02-17T23:35:54.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:54 smithi005 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a[74339]: level=info ts=2024-02-17T23:35:54.162Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-02-17T23:35:55.126 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:54 smithi005 bash[79453]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-alertmanager-a 2024-02-17T23:35:55.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:55 smithi005 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@alertmanager.a.service: Succeeded. 2024-02-17T23:35:55.626 INFO:journalctl@ceph.alertmanager.a.smithi005.stdout:Feb 17 23:35:55 smithi005 systemd[1]: Stopped Ceph alertmanager.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:36:06.965 DEBUG:teuthology.orchestra.run.smithi080:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1ffcdf7e-cdea-11ee-95ba-87774f69a715 --force 2024-02-17T23:36:08.140 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:36:07 smithi080 systemd[1]: Stopping Ceph node-exporter.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:36:08.140 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:36:07 smithi080 bash[69832]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter.b" found: no such container 2024-02-17T23:36:08.882 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:36:08 smithi080 bash[69872]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-node-exporter-b 2024-02-17T23:36:09.140 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:36:08 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-02-17T23:36:09.140 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:36:08 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@node-exporter.b.service: Failed with result 'exit-code'. 2024-02-17T23:36:09.140 INFO:journalctl@ceph.node-exporter.b.smithi080.stdout:Feb 17 23:36:08 smithi080 systemd[1]: Stopped Ceph node-exporter.b for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:36:09.140 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:36:09 smithi080 systemd[1]: Stopping Ceph grafana.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715... 2024-02-17T23:36:09.141 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:36:09 smithi080 bash[69972]: Error: no container with name or ID "ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana.a" found: no such container 2024-02-17T23:36:09.640 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:36:09 smithi080 ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a[67134]: t=2024-02-17T23:36:09+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-02-17T23:36:10.117 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:36:09 smithi080 bash[70010]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715-grafana-a 2024-02-17T23:36:10.390 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:36:10 smithi080 systemd[1]: ceph-1ffcdf7e-cdea-11ee-95ba-87774f69a715@grafana.a.service: Succeeded. 2024-02-17T23:36:10.390 INFO:journalctl@ceph.grafana.a.smithi080.stdout:Feb 17 23:36:10 smithi080 systemd[1]: Stopped Ceph grafana.a for 1ffcdf7e-cdea-11ee-95ba-87774f69a715. 2024-02-17T23:36:21.886 INFO:tasks.cephadm:Removing cephadm ... 2024-02-17T23:36:21.887 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-17T23:36:21.912 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf /home/ubuntu/cephtest/cephadm 2024-02-17T23:36:21.931 INFO:tasks.cephadm:Teardown complete 2024-02-17T23:36:21.931 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-02-17T23:36:21.944 INFO:teuthology.task.clock:Checking final clock skew... 2024-02-17T23:36:21.944 DEBUG:teuthology.orchestra.run.smithi005:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T23:36:21.954 DEBUG:teuthology.orchestra.run.smithi080:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-02-17T23:36:21.972 INFO:teuthology.orchestra.run.smithi005.stderr:bash: ntpq: command not found 2024-02-17T23:36:21.977 INFO:teuthology.orchestra.run.smithi005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T23:36:21.977 INFO:teuthology.orchestra.run.smithi005.stdout:=============================================================================== 2024-02-17T23:36:21.977 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 24 +3611us[+3858us] +/- 85ms 2024-02-17T23:36:21.977 INFO:teuthology.orchestra.run.smithi005.stdout:^* hv02.front.sepia.ceph.com 3 6 377 21 -1934us[-1688us] +/- 57ms 2024-02-17T23:36:21.977 INFO:teuthology.orchestra.run.smithi005.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 22 -392us[ -146us] +/- 86ms 2024-02-17T23:36:21.977 INFO:teuthology.orchestra.run.smithi005.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T23:36:21.987 INFO:teuthology.orchestra.run.smithi080.stderr:bash: ntpq: command not found 2024-02-17T23:36:21.991 INFO:teuthology.orchestra.run.smithi080.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-02-17T23:36:21.991 INFO:teuthology.orchestra.run.smithi080.stdout:=============================================================================== 2024-02-17T23:36:21.991 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 24 +3841us[+3841us] +/- 85ms 2024-02-17T23:36:21.991 INFO:teuthology.orchestra.run.smithi080.stdout:^* hv02.front.sepia.ceph.com 3 7 377 90 -1674us[-1701us] +/- 56ms 2024-02-17T23:36:21.991 INFO:teuthology.orchestra.run.smithi080.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 27 -156us[ -156us] +/- 86ms 2024-02-17T23:36:21.992 INFO:teuthology.orchestra.run.smithi080.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-02-17T23:36:21.994 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-02-17T23:36:22.003 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-02-17T23:36:22.004 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-02-17T23:36:22.013 DEBUG:teuthology.orchestra.run.smithi005:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-17T23:36:22.091 DEBUG:teuthology.orchestra.run.smithi080:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-02-17T23:36:22.154 DEBUG:teuthology.orchestra.run.smithi005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T23:36:22.185 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T23:36:22.186 DEBUG:teuthology.orchestra.run.smithi080:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-02-17T23:36:22.215 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T23:36:22.216 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-02-17T23:36:22.225 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-02-17T23:36:22.234 INFO:teuthology.task.internal:Duration was 1809.573251 seconds 2024-02-17T23:36:22.234 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-02-17T23:36:22.243 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-02-17T23:36:22.243 DEBUG:teuthology.orchestra.run.smithi005:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-17T23:36:22.246 DEBUG:teuthology.orchestra.run.smithi080:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-02-17T23:36:22.293 INFO:teuthology.orchestra.run.smithi005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T23:36:22.301 INFO:teuthology.orchestra.run.smithi080.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-02-17T23:36:22.398 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-02-17T23:36:22.398 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi005.front.sepia.ceph.com 2024-02-17T23:36:22.399 DEBUG:teuthology.orchestra.run.smithi005:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-17T23:36:22.422 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi080.front.sepia.ceph.com 2024-02-17T23:36:22.423 DEBUG:teuthology.orchestra.run.smithi080:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-02-17T23:36:22.444 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-02-17T23:36:22.445 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-17T23:36:22.465 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-02-17T23:36:22.552 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-02-17T23:36:22.552 DEBUG:teuthology.orchestra.run.smithi005:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-17T23:36:22.554 DEBUG:teuthology.orchestra.run.smithi080:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-02-17T23:36:22.767 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-02-17T23:36:22.777 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-02-17T23:36:22.777 DEBUG:teuthology.orchestra.run.smithi005:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-17T23:36:22.805 DEBUG:teuthology.orchestra.run.smithi080:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-02-17T23:36:22.832 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-02-17T23:36:22.842 DEBUG:teuthology.orchestra.run.smithi005:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-17T23:36:22.847 DEBUG:teuthology.orchestra.run.smithi080:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-02-17T23:36:22.872 INFO:teuthology.orchestra.run.smithi005.stdout:kernel.core_pattern = core 2024-02-17T23:36:22.899 INFO:teuthology.orchestra.run.smithi080.stdout:kernel.core_pattern = core 2024-02-17T23:36:22.932 DEBUG:teuthology.orchestra.run.smithi005:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-17T23:36:22.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T23:36:22.960 DEBUG:teuthology.orchestra.run.smithi080:> test -e /home/ubuntu/cephtest/archive/coredump 2024-02-17T23:36:22.989 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-02-17T23:36:22.990 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-02-17T23:36:23.002 INFO:teuthology.task.internal:Transferring archived files... 2024-02-17T23:36:23.002 DEBUG:teuthology.misc:Transferring archived files from smithi005:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822/remote/smithi005 2024-02-17T23:36:23.003 DEBUG:teuthology.orchestra.run.smithi005:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-17T23:36:23.054 DEBUG:teuthology.misc:Transferring archived files from smithi080:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822/remote/smithi080 2024-02-17T23:36:23.054 DEBUG:teuthology.orchestra.run.smithi080:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-02-17T23:36:23.099 INFO:teuthology.task.internal:Removing archive directory... 2024-02-17T23:36:23.100 DEBUG:teuthology.orchestra.run.smithi005:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-17T23:36:23.102 DEBUG:teuthology.orchestra.run.smithi080:> rm -rf -- /home/ubuntu/cephtest/archive 2024-02-17T23:36:23.149 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-02-17T23:36:23.160 INFO:teuthology.task.internal:Not uploading archives. 2024-02-17T23:36:23.161 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-02-17T23:36:23.170 INFO:teuthology.task.internal:Tidying up after the test... 2024-02-17T23:36:23.170 DEBUG:teuthology.orchestra.run.smithi005:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-17T23:36:23.172 DEBUG:teuthology.orchestra.run.smithi080:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-02-17T23:36:23.188 INFO:teuthology.orchestra.run.smithi005.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 23:36 /home/ubuntu/cephtest 2024-02-17T23:36:23.208 INFO:teuthology.orchestra.run.smithi080.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 17 23:36 /home/ubuntu/cephtest 2024-02-17T23:36:23.208 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-02-17T23:36:23.219 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-02-17T23:36:23.243 INFO:teuthology.nuke:Checking targets against current locks 2024-02-17T23:36:23.271 DEBUG:teuthology.nuke:shortname: smithi005 2024-02-17T23:36:23.272 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T23:36:23.296 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 22:57:55.546841', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEi/q6q9cSCdDsNG3vOT0GVRK20cTPyeLWTmaUOkRx/X7d4JixlnQrP1LBsInvMn9q18V+XH7R+Ene4+lX9R+8M='} 2024-02-17T23:36:23.297 DEBUG:teuthology.nuke:shortname: smithi080 2024-02-17T23:36:23.298 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-02-17T23:36:23.323 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi080.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-02-17_15:55:51-rados-pacific-release-distro-default-smithi/7564822', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-02-17 22:57:55.545014', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPac3XTqtko2AcPKYOPyZA5UxPGVtEyMaMfnnW0moZX1kkEY8S2VKHYV5qPwqcCwoyo9OIw+2lDqqaTPUxYoBCE='} 2024-02-17T23:36:23.350 INFO:teuthology.orchestra.console.smithi005:Power off 2024-02-17T23:36:23.350 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T23:36:23.377 DEBUG:teuthology.orchestra.console.smithi005:power off output: Chassis Power Control: Down/Off 2024-02-17T23:36:23.377 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T23:36:23.393 INFO:teuthology.orchestra.console.smithi080:Power off 2024-02-17T23:36:23.393 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-02-17T23:36:23.403 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-02-17T23:36:23.416 DEBUG:teuthology.orchestra.console.smithi080:power off output: Chassis Power Control: Down/Off 2024-02-17T23:36:23.416 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T23:36:23.441 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-02-17T23:36:27.404 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T23:36:27.442 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T23:36:27.514 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is on 2024-02-17T23:36:27.552 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is on 2024-02-17T23:36:31.516 DEBUG:teuthology.orchestra.console.smithi005:pexpect command: ipmitool -H smithi005.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T23:36:31.552 DEBUG:teuthology.orchestra.console.smithi080:pexpect command: ipmitool -H smithi080.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-02-17T23:36:31.626 DEBUG:teuthology.orchestra.console.smithi005:check power output: Chassis Power is off 2024-02-17T23:36:31.663 DEBUG:teuthology.orchestra.console.smithi080:check power output: Chassis Power is off 2024-02-17T23:36:31.727 INFO:teuthology.orchestra.console.smithi005:Power off completed 2024-02-17T23:36:31.763 INFO:teuthology.orchestra.console.smithi080:Power off completed 2024-02-17T23:36:31.868 INFO:teuthology.run:Summary data: description: rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-upgrade/simple 4-wait 5-upgrade-ls mon_election/classic} duration: 1809.5732505321503 failure_reason: '"2024-02-17T23:18:12.187714+0000 mon.a (mon.0) 482 : cluster [WRN] Health check failed: 1 stray daemons(s) not managed by cephadm (CEPHADM_STRAY_DAEMON)" in cluster log' owner: scheduled_yuriw@teuthology success: false 2024-02-17T23:36:31.868 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-02-17T23:36:31.958 INFO:teuthology.run:FAIL